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FOREWORD 


This  report  is  part  of  a  research  oroy^am  by  the  Army  Research  Institute 
for  the  Behavioral  and  Social  Sciences/(ARI )  to  develop  analytic  tools  for  es¬ 
timating  training  device  effectiveness.  To  date,  four  analytic  models  under 
the  heading ^“TRAINVICE'^Tiave  been  developed,  but  their  validity  is  still  in 
question  because  predictor  and  criterion  measurements  available  for  validation 
studies  are  few.  The  authors  of  this  report  were  able  to  get  these  measure¬ 
ments  from  transfer-of-training  data  gathered  on  four  training  devices  during 
the  operational  testing  of  an  MK-60  gunnery  trainer,  the  Videodisc  Integrated 
Gunnery  Simulator  (VIGS).  The  findings  indicate  that  TRAINVICE  scores  were 
reasonably  consistent  for  each  particular  model  between  raters.  However,  par¬ 
ticular  components  variables  of  each  model  showed  low  agreement  between  raters. 
The  authors  suggest  that  future  research  on  transfer  forecast  models  increase 
the  reliability  of  the  predictor  measures,  improve  the  criterion  measurement 
environment,  and  determine  the  scale  properties  of  the  models.  ^ 
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EXECUTIVE  SUMMARY 


Requi rement : 

Forecasting  transfer  from  examinations  of  device  and  other  training-system 
characteristics  has  been  the  subject  of  ARI-sponsored  research  for  several 
years.  This  report  is  part  of  an  ARI  program  to  develop  analytic  tools  for 
estimating  training  device  effectiveness. 


Procedure: 

Research  was  performed  to  assess  the  reliability  and  validity  of  a  set  of 
tools  called  TRAINVICE.  TRAINVICE  workbooks  were  prepared,  and  the  procedures 
were  applied  to  four  training  devices.  Empirical  data  were  collected  in  order 
to  relate  the  predictor  estimates  from  TRAINVICE  to  the  criterion  measures 
(transfer  data). 


Findings: 

The  overall  TRAINVICE  scores  were  reasonably  consistent  between  raters  for 
each  particular  model.  However,  examining  the  component  variables  of  each 
model  shows  low  agreement  for  particular  classes  of  variables  within  models. 
These  variables  require  the  more  subjective  judgments. 

The  results  of  the  data  collection  indicate  the  difficulties  inherent  in 
collecting  criterion  data.  The  lack  of  control  over  the  collection  yielded 
data  without  variance. 


Utilization  of  Findings: 

Future  research  on  transfer  forecast  models  must  increase  the  reliability 
of  the  predictor  measures,  improve  the  criterion  measurement  environment,  and 
determine  the  scale  properties  of  the  models. 
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APPLICATION  OF  TRANSFER  FORECAST  METHODS 
TO  ARMOR  TRAINING  DEVICES 


This  report  is  part  of  an  Army  Research  Institute  program  to  develop 
analytic  tools  for  estimating  training  device  effectiveness.  Research  was 
performed  to  assess  the  reliability  and  validity  of  a  set  of  tools  called 
TRAINVICE.  TRAINVICE  workbooks  were  prepared  and  the  procedures  applied  to 
four  training  devices.  Empirical  data  were  collected  in  order  to  relate  the 
predictor  estimates  from  TRAINVICE  to  the  criterion  measures.  Extensive 
information  was  gathered  on  how  consistently  each  TRAINVICE  version  and 
sub-scale  of  each  version  is  applied.  Problems  were  uncovered  with 

application  and  improved  procedures  suggested  for  using  the  methods. 

Background 

The  training  device  acquisition  process  begins  when  a  training  need  is 
Identified  to  support  a  new  weapon  system  or  to  solve  a  training  deficiency 
for  an  existing  system.  During  the  phase  of  concept  formulation,  developers 
consider  tasks  to  be  trained,  trainee  characteristics,  alternative  hardware 
configurations,  simulation  technology,  and  costs.  Several  alternative  device 
concepts  may  be  considered.  The  acquisition  process  depends  on  the  cost 
level,  existence  of  commercially  available  devices,  developmental  risks,  and, 
for  a  developing  weapon  system,  the  progress  of  the  parent  system  through  its 
acquisition  process. 

In  general,  data  available  early  in  the  device  acquisition  process  are 
subjective  (e.g.,  judgments  of  subject  matter  experts),  low  in  resolution, 
and  qualitative.  These  low-quality  data  are  all  that  are  available  at  the 
very  time  that  the  technological  risks  are  high  (e.g.,  early  decisions  may 
guide  the  device  to  or  from  high  cost  alternatives  that  do  or  do  not  use  the 
technological  state  of  the  art).  Data  available  later  in  the  device 
acquisition  process  are  more  objective,  quantitative,  and  empirical. 


However,  even  after  the  production  of  a  device,  empirical  testing  may  be 
omitted  because  of  prohibitive  costs. 

The  combined  cost  of  empirical  research  and  scarcity  of  objective  data 
during  the  acquisition  process  press  the  need  for  structured,  quantifiable 
algorithms  for  predicting  the  degree  to  which  training  on  devices  and  simu¬ 
lators  transfers  to  the  actual  equipment.  Forecasting  transfer  from  examina¬ 
tions  of  device  and  other  training-system  characteristics  has  been  the 
subject  of  ARI-sponsored  research  for  several  years.  The  Army  has  developed 
a  family  of  predictive  models  known  collectively  as  TRAINVICE.  As  Tufano  and 
Evans  indicate  (1982),  these  four  model-  represent  "the  most  ambitious  steps 
taken  to  date  in  the  field  of  analytic  evaluation"  (p.  2).  The  original 
TRAINVICE  model  resulted  from  a  review  by  Wheaton,  Rose,  Fingerman,  Korotkin, 
and  Holding  (1976)  of  several  methods  for  estimating  the  effectiveness  of 
proposed  training  devices.  They  found  the  estimation  procedure's  generally 
inadequate.  A  new  forecast  method  was  proposed  (Wheaton,  Fingerman,  Rose, 
and  Leonard,  1976)  that  predicted  transfer  of  training  based  on  the  training 
variables  (tasks,  behaviors)  and  device  variables  (appropriateness, 
efficiency,  effectiveness).  This  model  is  TRAINVICE  I  (TVI).  As  part  of  an 
effort  to  develop  detailed  guidance  for  user  application,  TVI  was  modified 
(PM-TRADE,  1979)  and  Is  referred  to  as  TRAINVICE  II  (TVII). 

Narva  (1979)  tried  to  make  the  transfer  prediction  more  procedural  and 
easier  for  Army  analysts  to  use.  He  divided  the  procedures  into  those  that 
answered  three  questions  about  the  proposed  training  device.  First,  what  Is 
to  be  represented  In  the  training  device?  "What"  refers  to  the  units  of 
activity  to  be  trained.  Second,  why  Is  the  unit  of  activity  Included?  The 
reasons  are  training  criticality  and  training  difficulty.  Third,  how  are  the 
activities  to  be  conveyed  by  the  device,  and  how  are  they  to  be  taught?  The 
ways  cover  the  physical  and  functional  characteristics  of  the  device.  The 
functional  characteristics  were  adapted  from  the  Training  Effectiveness  and 
Cost  Effectiveness  Prediction  (TECEP)  procedure  developed  by  the  Navy's 
Training  and  Evaluation  Group  (Braby,  Henry,  Parris,  and  Swope,  1975). 
Narva's  model  is  TRAINVICE  III  ( TV III).  In  an  effort  to  develop  a  user 


guidebook  for  applying  TVIII,  Swezey  and  Evans  made  additional  revisions 
(1980).  This  approach  is  referred  to  as  TRAINVICE  IV  (TVIV). 

The  four  models  share  a  common  data  collection  method.  As  summarized  by 
Tufano  and  Evans  (1982), 

This  method  consists  of  a  structured  Interrogation  of  a 
subject  matter  expert.  As  such,  the  models  place  a  very 
high  premium  on  the  judgment  of  an  expert.  The  method 
focuses  decision-making  on  a  specific  set  of  issues  for 
each  task  or  part  of  a  task.  In  the  first  of  the  TRAIN- 
VICE  models,  for  example,  one  of  the  issues  considered 
is  the  similarity  between  the  equipment  on  a  training 
device  and  that  on  the  operational  equipment  to  perform 
a  particular  subtask.  This  issue  is  further  delineated 
into  physical  similarity  (appearance,  location,  etc.) 
and  functional  similarity  (amount  of  information  flow 
between  the  human  operator  and  the  controls  and 
displays)  ....  The  judgments  of  the  subject  matter 
expert  and  the  index  of  effectiveness  rely  on  many 
assumptions,  both  theoretical  and  mathematical  in 
nature.  The  theoretical  assumptions  include:  (a)  what 
is  being  predicted  (e.g.,  a  particular  measure  of 
transfer  of  training);  and  (b)  which  task  and  equipment 
variables  have  the  predictive  power  to  generate  such  a 
measure  of  effectiveness.  The  mathematical  assumptions 
concern:  (a)  the  manner  in  which  all  the  values  are 

combined;  and  (b)  the  numerical  properties  of  the  rating 
scales  used  to  estimate  those  values  (1982,  p.  2) 

Differences  in  assumptions  are  manifested  in  the  models  in  several 
important  ways.  For  example,  the  mathematical  weight  of  each  of  the 
variables  considered  in  the  calculation  of  the  indices  are  given  different 
degrees  of  emphasis  in  each  model.  The  procedures  used  to  estimate  the 
values  for  each  component  vary  considerably  from  model  to  model.  Moreover, 
the  procedures  used  to  calculate  an  index  of  effectiveness  from  the  variable 
values  are  also  very  different  in  each  model  (Tufano  and  Evans,  1982,  p.  1). 

Rationale 

Opportunities  to  try  out  the  models,  and  to  use  tryout  results  to  revise 
the  models  for  improved  prediction  have,  unfortunately,  been  limited.  In 
some  cases  (Wheaton,  et.  a!.,  1976),  predictor  values  were  reliably  estimated 


but  the  opportunity  for  criterion  data  collection  was  absent.  In  other  cases 
(Holman,  1979),  the  original  model  was  revised  without  benefit  of  either 
predictor  estimation  or  criterion  measurement. 


Mainly  because  of  practical  constraints  (i.e.,  cost,  availability  of 
devices,  parent  equipment,  subjects,  and  subject  matter  experts),  the  cases 
in  which  predictor  and  criterion  measurement  occur  are  few.  Investigators 
have  been  forced  by  practical  constraints  to  await  opportunities  in  which 
both  prediction  and  criterion  measurement  could  be  accomplished.  An 
opportunity  arose  recently  during  the  operational  testing  of  an  MK-60  gunnery 
trainer,  the  Videodisc  Integrated  Gunnery  Simulator  (VIGS). 

Data  were  to  be  collected  on  transfer  as  a  function  of  training  which 
used  the  VIGS,  as  well  as  three  alternative  training  devices.  Since 
criterion  and  transfer  data  were  to  be  collected  in  any  event  fW  training 
that  used  the  devices,  all  that  is  required  to  test  transfer-forecast  models 
is  to  generate  reliable  estimates  of  predictor  dimensions,  and  combine  the 
estimates  as  prescribed  by  the  models  to  generate  transfer  forecasts. 

Objectives 

The  research  described  in  this  report  was  performed  as  part  of  the  ARI 
program  to  validate  and  refine  TRAINVICE  methodology.  The  specific 
objectives  were  to: 

(1)  Determine  how  reliably  subject  matter  experts  (SME)  can  make  the 
judgments  needed  to  compute  TRAINVICE  estimates. 

(2)  Determine  how  valid  the  estimates  are'. 


(3)  Recommend  how  TRAINVICE  judgments  and  estimates  can  be  made  more 
reliable,  valid,  and  efficient. 


METHOD-PREDICTORS 


Four  tasks  were  performed  to  determine  how  reliably  SME  make  judgments 
needed  to  compute  TRAINVICE  estimates.  The  four  tasks  were  (1)  select 
devices,  (2)  select  gunnery  engagement,  (3)  prepare  workbooks,  and  (4) 
perform  ratings. 

Select  Devices 

Four  Armor  gunnery  training  devices  were  selected  and  each  model  was 
applied.  The  devices  were  the  MK-60  Gunnery  Trainer  (VIGS),  the 
burst-on-target  (BOT)  trainer;  the  M55  laser  tank  gunnery  trainer;  and  the 
subcaliber  5.56mm  Brewster  device  (BRW). 

MK-60  Gunnery  Trainer  (VIGS) 

The  MK-60  is  a  portable  electronic  training  device  designed  to  provide 
soldiers  with  realistic  and  effective  target  engagement  skills  training  for 
both  novice  and  experienced  gunners.  The  trainer  combines  video  disc  and 
microcomputer  technologies.  The  gunner  sees  targets  through  an  optical 
system  that  combines  the  Image  with  a  projected  reticle,  tracks  the  target 
and  fires.  Computer  generated  graphics  display  hits,  misses,  and  tracers  in 
the  gunner's  sight-picture  and  an  external  monitor.  Performance  Is  assessed 
by  the  microcomputer  and  feedback  given  to  the  gunner  on  a  black  and  white 
scorecard  CRT  at  the  gunner's  console. 

Burst-on-Target-Tralner  (BOT) 

The  BOT  uses  simulated  tank  turret  controls  and  a  gunner's  sight  for 
operation.  The  trainer  provides  a  target  and  reticle  which  move  with  respect 
to  each  other  when  the  controls  are  actuated.  The  targets  are  various  35mm 
color  slide  transparencies  of  enemy  tanks  or  vehicles  and  projected  into  the 
sight  picture  by  a  standard  carousel  projector  mounted  within  the  trainer. 
When  the  gunner  Is  on  target  and  fires  the  main  gun,  a  flash  of  laser  light 
simulates  the  round  burst.  The  Instructor  can  view  the  scene  and  has 
independent  control  of  the  burst  position  to  simulate  various  trajectories. 


M55  Laser  Tank  Gunnery  Trainer 

The  M55  trainer  is  installed  in  the  M60Al's  M73/M219  machine  gun  mount. 
Each  time  the  main  gun  is  fired,  the  simulator  provides  a  single  burst  of  red 
light,  visible  through  the  optics.  This  lets  the  gunner  accurately  determine 
how  well  he  is  laying  his  gun  sights  and  tracking  the  target.  In  addition,  a 
supervising  scorer  can  observe  how  accurately  and  proficiently  the  gunner  is 
operating  the  tank’s  main  weapon  system.  The  trainer  is  used  specifically  to 
train  on  the  proper  techniques  of: 

o  laying  sights  on  a  target 
o  tracking  a  target 
o  firing  the  gun 

o  visually  adjusting  the  lay  of  the  weapon  on  a  target. 

Subcaliber  5.56mm  Brewster  Device  (BRW)  , 

The  BRW  is  a  mounting  device  which  permits  use  of  the  M16  rifle  or  M55 
laser  for  subcaliber  firing  at  reduced  range.  The  device  is  used  in 
conjunction  with  the  scaled  range  target  system  and  is  wired  to  the  control 
firing  circuit  and  fired  by  the  gunner's  firing  trigger. 

Select  Gunnery  Engagement 

A  primary  consideration  during  the  planning  phase  of  this  project  was  to 
prevent  the  amount  of  material  to  be  rated  from  overshadowing  the  issue  of 
Interest — the  validity  of  the  TRAINVICE  models.  For  this  reason,  only  one 
gunnery  engagement  task  with  its  appropriate  subtasks,  controls,  displays, 
knowledges,  and  skills  was  selected  to  be  rated  for  each  TRAINVICE  model. 

A  stationary  firing  tank,  moving  target  tank,  precision-periscope 
engagement  was  selected.  Four  behaviors  for  a  direct  fire  engagement  using 
BOT  were  added  to  the  eight  gunner  behaviors  for  that  engagement.  These  four 
behaviors  were  derived  from  FM17-12,  Tank  Gunnery.  Thus,  the  criterion 
gunnery  engagement  contains  12  analytically  derived  behavioral  elements  which 
are  the  subtasks  in  TVI  and  the  task  elements  in  TV II.  The  gunnery 
engagement  with  behavioral  elements  is  shown  at  Figure 
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Precision,  periscope,  stationary  firing  tank,  moving  tank  target 
(1200-1600)  meters),  SABOT,  direct  fire  adjustment  (BOT) 


GUNNER  BEHAVIORAL  ELEMENTS 

1.  Gunner  indexes  ammunition. 

2.  Gunner  turns  on  main  gun  switch. 

3.  Gunner  announces  IDENTIFIED. 

4.  Gunner  applies  lead  in  direction  of  target  apparent 
motion. 

5.  Gunner  lays  crosshair  leadline  at  center  of  target 
vulnerability. 

6.  Gunner  makes  final  precise  lay. 

7.  Gunner  announces  ON  THE  WAY. 

8.  Gunner  fires  main  gun. 

9.  Gunner  announces  sensing  and  BOT. 

10.  Gunner  relays  (BOT). 

11.  Gunner  announces  ON  THE  WAY  (BOT). 

12.  Gunner  fires  main  gun  (BOT). 


The  gunnery  engagement  and  gunner  behaviors  come  from  two  sources. 

1.  Boldovici,  J.A.  (HumRRO) ,  Boycan,  G.G.  (ARI),  Flngerman  and 

Wheaton  (AIR).  M60A1A0S  Tank'  Gunnery  Data  Handbook,  ARI 

Technical  Report  TR-?9-A7,  March,  1$)9. 

2.  US  Army,  FM17-12,  Tank  Gunnery.  March,  1977. 


Figure  1.  Gunnery  Engagement 


The  controls  and  displays  were  derived  for  each  behavioral  element  using 
the  following  basic  guidelines:  A  control  is  something  the  operator  acts  on; 
a  display  is  something  that  provides  information  to  the  operator  so  that  he 
can  act  on  a  control.  The  analysis  yf elded  six  controls  (e.g.,  main  gun 
switch.  Gunner's  control  handles)  and  seven  displays  (e.g.,  main  gun  switch 
light,  reticle).  The  set  of  controls  and  displays  is  presented  in  Figure  2. 

The  knowledge  and  skills  were  derived  for  each  behavioral  element  as 
follows:  Knowledges  and  skills  are  the  mental  and  motor  components  of  the 
behavioral  elements  that  have  special  requirements  for  minimum  performance. 
Any  knowledge  or  skill  that  could  be  learned  or  performed  simply  in  response 
to  verbal  or  written  instructions  was  not  Identified  as  a  knowledge  or  skill 
here.  For  example,  "knows  location  of  ammunition  selector  handle"  is  not  a 
knowledge  component  for  the  behavioral  element  “Gunner  indexes  ammunition," 
since  soldiers  would  remember  the  location  after  a  single  showing.  Eleven 
knowledges  (e.g.,  knows  number  of  lead  lines  for  ammunition  types)  and  four 
skills  (e.g.,  is  able  to  estimate  speed  of  target)  were  Identified.  They  are 
listed  in  Figure  2.  The  controls,  displays,  knowledges,  and  skills 
associated  with  each  behavioral  element  are  given  in  Figure  3. 

Prepare  Workbooks 

In  preparing  to  apply  the  various  models,  procedures  were  extracted  from 
reports  describing  TVI  (Wheaton,  et  al.,  1976),  TVII  (PM-TRADE,  1979),  and 
TVIV  (Swezey  and  Evans,  1980)  for  rating  devices.  Three  workbooks  were 
prepared  from  the  extracted  procedures.  The  Intent  of  the  workbooks  was  to 
enable  raters  to  make  judgments  about  a  device  In  terms  of  the  model 
component  without  being  distracted  by  other  material  presented  in  the 
descriptive  reports. 

The  TVII I  (Narva,  1979)  model  Is  almost  identical  with  TVIV  regarding 
the  variables  or  model  components  considered  and  in  the  procedures  used  to 
estimate  these  variables.  For  that  reason,  a  workbook  was  prepared  and 
ratings  made  for  TVIV;  these  data  were  then  used  to  calculate  TRAINVICE 
scores  for  both  TVI I I  and  TVIV.  The  three  models  for  which  workbooks  were 


CONTROLS 


C}  Ammunition  selector  handle. 

C2  Main  gun  switch. 

C3  Microphone 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

Cg  Firing  triggers. 

DISPLAYS 

Di  Earphones. 

D2  Ammunition  display  window. 

O3  Main  gun  switch  light. 

D4  M-32  sight  (eyepiece,  headrest,  8X  magnification). 

D5  Moving  target. 

Dg  Reticle. 

D7  Burst  of  main  gun  round. 

KNOWLEDGES 

K3  Knows  procedure  to  Index  ammunition  (Including  when  to  Index  ammunition). 
K2  Knows  that  saying  IDENTIFIED  is  response  to  TC  saying  GUNNER,  (AMMO  TYPE), 
(TARGET  TYPE)  and  Gunner  seeing  the  target. 

K3  Knows  number  of  leadlines  for  ammunition  types. 

K4  Knows  number  of  leadlines  for  speed  of  target. 

K5  Knows  crosshair  leadline  Is  placed  on  target's  center  of  mass  (with  lead 
applied). 

Kg  Knows  that  saying  ON  THE  WAY  Is  response  to  crosshair  leadline  being  on 
target's  center  of  mass,  TC  saying  FIRE,  and  Loader  saying  UP. 

K7  Knows  that  sensing  Is  mental  notation  of  the  point  In  the  sight  reticle 
where  burst  of  round  appears  as  it  passes,  strikes  short  of,  or  hits  the 
target. 

K3  Knows  there  are  three  deflection  sensings  (LEFT,  RIGHT,  LINE)  and  four 
range  sensings  (SHORT,  OVER,  DOUBTFUL,  TARGET). 

Kg  Knows  that  saying  BOT  is  response  to  sensing  round. 

KjoKnows  to  move  point  of  sight  reticle  by  most  direct  route  from  where  burst 
of  round  appears  to  target's  center  of  mass. 

KjiKnows  that  saying  ON  THE  WAY  Is  response  to  point  of  sight  reticle  where 
burst  of  round  appears  being  on  target's  cerfter  of  mass  and  Loader  saying 
UP. 

SKILLS 

S}  Is  able  to  distinguish  between  targets  and  friendlies. 

52  Is  able  to  estimate  speed  of  target. 

53  Is  able  to  maintain  smooth  track. 

54  Is  able  to  sense  rounds. 


Figure  2.  Controls  (C),  Displays  (D),  Knowledges  (D),  and  Skills  (S) 


1.  GUNNER  INDEXES  AMMUNITION 

Cj  Ammunition  selector  handle. 

Dx  Earphones  (GUNNER,  SABOT,  MOVING  TANK). 

D2  Ammunition  display  window. 

Ki  Knows  procedure  to  Index  ammunition  (including  when  to  index 
ammunition). 


2.  GUNNER  TURNS  ON  MAIN  GUN  SWITCH 
C2  Main  gun  switch. 

Oi  Earphones  (GUNNER,  SABOT,  MOVING  TANK). 
D3  Main  gun  switch  light. 


3.  GUNNER  ANNOUNCES  IDENTIFIED 
C3  Microphone  (IDENTIFIED). 

Di  Earphones  (GUNNER,  SABOT,  MOVING  TANK). 

D4  M-32  sight  (eyepiece,  headrest,  8X  magni fixation) . 

D5  Moving  target. 

K2  Knows  that  saying  IDENTIFIED  is  response  to  TC  saying  GUNNER,  (AMMO 
TYPE),  (TARGET  TYPE)  and  Gunner  seeing  the  target.  ( 

Sj  Is  able  to  distinguish  between  targets  and  friendlies. 


4.  GUNNER  APPLIES  LEAD 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

D4  M-32  sight. 

06  Reticle. 

D5  Moving  target. 

K3  Knows  number  of  leadlines  for  ammunition  types. 
K4  Knows  number  of  leadlines  for  speed  of  target. 

52  Is  able  to  estimate  speed  of  target. 

53  Is  able  to  maintain  smooth  track. 


5.  GUNNER  LAYS  CROSSHAIR  LEADLINE 
C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

D4  M-32  sight. 

De  Reticle. 

D5  Moving  target. 

K5  Knows  crosshair  leadline  Is  placed  on  target's  center  of  mass  (with 
lead  applied). 

S3  Is  able  to  maintain  smooth  track 


Figure  3.  Controls  (C),  Displays  (D),  Knowledges  (K),  and  Skills  (S)  for 
Behavioral  Elements. 
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6.  GUNNER  MAKES  FINAL  PRECISE  LAY 
C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

O4  M-32  sight. 

Dg  Reticle. 

D5  Moving  target. 

Ks  Knows  crosshair  leadline  Is  placed  on  target's  center  of  mass  (with 
lead  applied). 

S3  Is  able  to  maintain  smooth  track. 

7.  GUNNER  ANNOUNCES  ON  THE  WAY 
C3  Microphone  (ON  THE  WAY). 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

Di  Earphones  (UP,  FIRE). 

04  M-32  sight. 

D5  Moving  target. 

Dg  Reticle. 

Kg  Knows  that  saying  ON  THE  WAY  Is  response  to  crosshair  leadline  being 
on  target's  center  of  mass,  TC  saying  FIRE,  and  Loader  saying  UP. 

S3  Is  able  to  maintain  smooth  track. 

I 

8.  GUNNER  FIRES  MAIN  GUN 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

Cg  Firing  triggers. 

D4  M-32  sight. 

D5  Moving  target. 

Dg  Reticle. 

53  Is  able  to  maintain  smooth  track. 

9.  GUNNER  ANNOUNCES  SENSING  AND  BOT 
D4  M-32  sight. 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

C3  Microphone  (ON  THE  WAY). 

Dg  Reticle. 

D5  Moving  target. 

D7  Burst  of  main  gun  round. 

K7  Knows  that  sensing  Is  mental  notation  of  the  point  In  the  sight 
reticle  where  burst  of  round  appears  as  It  passes,  strikes  short  of, 
or  hits  the  target. 

Kg  Knows  there  are  three  deflection  sensings  (LEFT,  RIGHT,  LINE)  and 
four  range  sensings  (SHORT,  OVER,  DOUBTFUL,  TARGET). 

Kg  Knows  that  saying  BOT  Is  response  to  sensing  round. 

54  Is  able  to  sense  rounds. 


Figure  3.  Controls  (C),  Displays  (D),  Knowledges  (K),  and  Skills  (S)  for 
Behavioral  Elements  (Continued). 
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10.  GUNNER  RELAYS  (80T) 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

D4  M-32  sight. 

O5  Moving  target. 

Dg  Reticle. 

D7  Burst  of  main  gun  round. 

KioKnows  to  move  point  of  sight  reticle  by  most  direct  route  from  where 
burst  of  round  appears  to  target's  center  of  mass. 

52  Is  able  to  estimate  speed  of  target. 

53  Is  able  to  maintain  smooth  track. 

11.  GUNNER  ANNOUNCES  ON  THE  WAY  (BOT) 

C3  Microphone  (ON  THE  WAY). 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

Dj  Earphones  (UP,  FIRE). 

D4  M-32  sight. 

O5  Moving  target. 

Dg  Reticle. 

Kj  Knows  that  saying  ON  THE  WAY  Is  response  to  point  of  sight  reticle 
where  burst  of  round  appears  being  on  target's  center  of  mass  and 
Loader  saying  UP. 

S3  Is  able  to  maintain  smooth  track. 

12.  GUNNER  FIRES  MAIN  GUN  (BOT) 

C4  Gunner's  control  handles. 

C5  Magnetic  brake  palm  switches. 

Cg  Firing  triggers. 

D4  M-32  sight. 

O5  Moving  target. 

Dg  Reticle. 

S3  Is  able  to  maintain  smooth  track. 


Figure  3.  Controls  (C),  Displays  (D),  Knowledges  (K),  and  Skills  (S)  for 
Behavioral  Elements  (Continued). 


prepared  involve  several  general  types  of  preparatory  analyses;  these 
analyses  are  shown  in  Table  1.  The  reader  is  referred  to  Tufano  and  Evans 
(1982)  for  a  thorough  discussion  of  the  preparatory  analyses  and  model 
variables.  A  description  of  the  preparation  of  the  workbooks  follows. 

Prepare  Workbook  for  TV1 

The  details  for  procedures  and  assumptions  were  increased  and  the  rating 
procedures  and  instructions  were  geared  to  military  raters.  The  workbook 
with  subtasks,  controls,  displays,  skills,  and  knowledges  appropriately 
entered  is  presented  in  Appendix  A.  Following  are  the  specific  revisions  or 
recommended  revisions. 

Physical  similarity  analysis  (PSA).  The  PSA  judges  how  well  displays 
and  controls  are  represented  in  the  training  device.  The  instruction  to  base 
the  assessment  on  physical  similarity  and  ignore  amount  and  quality  of  infor¬ 
mation  was  moved  from  the  definition  of  rating  scale  value  3  to  the  general 
instructions  since  it  seemed  to  apply  to  all  ratings.  Also,  the  reference  to 
" jnd"  was  deleted. 

Functional  similarity  analysis  (FSA).  The  FSA  determines  the  informa¬ 
tion  processes  of  the  operator  (type,  amount,  and  direction  of  Information) 
for  each  display  and  control  and  then  compares  the  information  requirements 
in  the  device  to  those  In  the  operational  equipment.  The  approach  recom¬ 
mended  for  this  analysis  Is  considerably  different  from  the  Wheaton,  et  al . 
(1976)  procedures.  The  revision  was  driven  by  the  requirement  for  the  rater 
to  understand  how  to  estimate  the  number  of  alternatives  for  a  control  or 
display.  This  seemed  essential  to  enable  later  examination  of  the  reli¬ 
ability  of  the  analysis.  The  Instructions  were  modified  so  that  the  rater 
determined  the  number  of  alternatives  that  the  display  or  control  under 
consideration  could  assume.  This  procedure  was  further  modified  by  requiring 
the  rater  to  determine  whether  the  operator  acts  on  the  same  amount  of 
Information  for  a  control  or  display  in  the  same  way  for  both  the  operational 
and  the  training  situation. 
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Learning  deficit  analysis  (LDA).  In  TV  I,  the  LDA  determines  the  dif¬ 
ference  between  the  trainees'  repertory  of  skills  and  knowledges  and  the 
level  required  to  perform  a  subtask.  In  TYII,  the  LDA  estimates  how  much  the 
trainees  have  to  learn,  weighted  by  the  time  required  to  train  them. 
TRAINVICE  IV  assesses  the  degree  of  proficiency  required  and  the  learning 
difficulty  of  each  skill.  The  definitions  for  Repertory  Scale  appeared  to 
refer  too  much  to  amount  and  type  of  training.  The  typical  soldier  described 
for  the  raters  was  a  high  school  graduate  in  Armor  OSUT  who  has  completed  the 
common  soldier  and  tank  driver  blocks  of  instruction  and  was  about  to  enter 
the  gunnery  phase  of  training.  In  this  case,  soldiers  will  not  have  received 
any  training  on  any  of  the  knowledges  or  skills,  but  they  may  have  various 
levels  of  proficiency  on  the  skills.  For  example,  the  typical  soldier  would 
probably  be  able  to  estimate  one  second  "completely  and  accurately  without 
supervision"  (part  of  the  definition  for  a  score  of  4).  But  he  would  not 
have  received  skill  training  on  estimating  (the  remainder  of  triat  defini¬ 
tion).  Raters  then  could  logically  assign  anything  from  a  0  to  a  4  depending 
on  whether  they  focus  on  level  of  proficiency  or  amount  and  type  of  train¬ 
ing.  The  amount  and  type  of  training  received  was  deleted  from  the 
definitions. 

The  Criterion  Scale  definitions  seemed  to  be  oriented  toward  describing 
the  status  of  an  imperfectly  trained  solider.  Again,  the  focus  needed  to  be 
on  the  requirements  of  the  criterion  task  (hit  moving  target)  rather  than  on 
the  type  of  training  received  or  the  amount  of  further  training  required. 
For  example,  statements  such  as  "needs  more  practice  under  supervision"  may 
divert  raters  from  the  task  requirements  to  the  quality  of  an  unspecified 
training  program.  The  scale  value  defintions  were  revised  to  focus  on 
knowledge  or  skill  requirements  of  the  criterion  task. 

Training  techniques  analysis  (TTA).  The  purpose  of  the  TTA  Is  to 
establish  how  well  a  device  Implements  established  learning  principles.  This 
Is  done  by  using  TECEP  categories  to  determine  task  categories  and  rate  how 
well  the  device  Implements  the  associated  TECEP  learning  guidelines  (from  a 
"-3"  which  Infers  violation  of  a  principle  to  a  "3”  which  Infers  optimal 
implementation).  The  rater  identifies  the  lowest  rating  of  each  task 


category  and  then  averages  and  scales  these  scores  to  yield  a  "T"  score 
between  "0"  and  "1". 

The  procedures  associated  with  this  analysis  were  not  clear  in 
specifying  when  the  rater  should  rate  the  principles  for  each  task  category. 
That  is,  should  the  rater  rate  every  category  or  should  the  rater  first 
determine  which  principles  are  relevant  to  the  sub tasks  being  rated. 
Determining  the  relevant  principles  before  rating  appeared  to  be  more 
reasonable  in  that  a  principle  may  be  more  relevant  to  some  subtasks  but  not 
others.  For  instance,  the  mnemonic  to  apply  to  adjusting  lead  to  compensate 
for  motion  in  the  firing  tank  is  not  apparent.  But  the  lack  of  apparent 
relevance  does  not  affect  the  comparative  effectiveness  of  a  device.  This 
can  be  a  problem  because  the  model  only  incorporates  the  lowest  rating  in  a 
cell.  An  irrelevant  principle  would  wash  out  any  positive  applications  of 
learning  principles.  ' 

Despite  this  theoretical  drawback,  the  instructions  call  for  rating  each 
principle  in  each  cell.  The  main  reason  for  that  instruction  is  the  defini¬ 
tion  of  zero  in  the  scale.  One  reason  for  a  zero  is  that  the  principle  is 
irrelevant.  That  implies  that  there  is  no  screening  for  relevance.  A  more 
basic  problem  relates  to  the  purpose  of  the  analysis.  Research  Memorandum 
76-16  (Wheaton,  et  al.)  states  that  the  purpose  is  to  tell  the  Incremented 
training  value  that  a  specific  device  possesses  over  operational  equipment 
(p.  39).  However,  the  procedure  makes  no  reference  to  operational  equip¬ 
ment.  The  Memorandum  later  recommends  an  approach  which  assigns  the  zero 
point  to  the  operational  equipment  and  rates  each  device  in  terms  of  gain  or 
decrease  compared  with  that  equipment  (p.  43).  Such  a  modification  would 
also  resolve  the  relevance  problem.  This  approach,  if  adopted,  would 
probably  require  use  of  the  average  score  rather  than  the  lowest  score. 

Two  recommendations  are  presented  for  revisions  to  the  training 
techniques  analysis  procedure.  They  are: 

1.  Rework  the  scale  to  compare  devices'  application  of 

principles  with  operational  equipment's  application  of 
principles;  or. 


2. 


Continue  with  current  procedures  but  have  raters  screen 
principles  in  each  relevant  cell  to  identify  the 
principles  that  apply  to  the  subtask.  Eliminate 
"inapplicable  or  irrelevant"  from  the  definition  for 
zero. 

Prepare  Workbook  for  TVII 

The  main  confusion  with  TVII  instructions  related  to  unique  elements  and 
controls.  A  device  is  supposed  to  be  penalized  for  task  elements  and 
controls  that  are  "unique  to  the  device  but  not  needed."  The  materials  ( PM— 
TRADE,  1979)  give  no  examples.  Since  the  analysis  proceeds  by  task,  the  most 
likely  interpretation  is  to  penalize  features  that  are  unrelated  to  the  task 
being  considered.  By  a  strict  interpretation,  the  ability  to  show  motion, 
for  example,  would  be  unique  for  the  task  "engage  stationary  targets."  But 
the  scope  of  a  task  is  often  arbitrary.  In  this  case  the  task  could  just  as 
easily  be  "fire  main  gun"  in  which  case  the  ability  to  show  motioh  would  not 
be  a  unique  element.  The  instructions  therefore  call  for  considering  an 
element  unique  if  it  is  unrelated  to  entry-level  gunnery.  The  rating  sheets 
were  modified  so  that  raters  would  list  what  they  considered  to  be  unique 
elements.  The  TVII  Workbook  is  in  Appendix  B. 

Prepare  Workbook  for  TVIV 

The  problems  with  TVIV  related  to  the  definitions  for  Training  Profi¬ 
ciency  and  Learning  Difficulty.  The  confusion  stemmed  from  the  definitions 
for  the  scale  values.  Training  Proficiency  is  supposed  to  describe  the 
ability  of  the  soldier  that  the  system  requires.  But  the  definitions  refer 
primarily  to  the  amount  or  quality  of  training  received.  When  the  system 
requirements  are  mentioned,  the  context  is  illogical:  A  rater  gives  a  1  when 
the  system  would  require  only  a  limited  knowledge  and  would  be  seriously 
degraded  by  limited  knowledge.  Raters  with  a  criterion  referenced  attitude 
would  have  trouble  telling  the  difference  between  a  minimally  competent  and 
an  adequate  skill,  particularly  when  system  requirements  are  being  asked 
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for.  Similarly,  the  definition  of  expert-level  skill  is  also  not  consonant 
with  the  purpose.  The  following  scale  value  definitions  are  recommended: 


Rating  Definition 

1  Should  have  skill  or  knowledge  equivalent  to  briefing  on 
knowledge  or  one  performance  of  skill.  System  will 
tolerate  frequent  errors. 

2  Should  have  skill  or  knowledge  equivalent  to  briefing 
and  some  practice,  but  does  not  need  to  be  able  to 
apply  knowledge  or  skill  without  error.  System  will 
tolerate  occasional  errors. 

3  Should  be  able  to  apply  skill  or  knowledge  under  most 
conditions  without  hesitation.  System  will  tolerate 
infrequent  errors. 

4  Should  be  able  to  apply  skill  or  knowledge  under  all 
conditions  without  hesitation.  System  will  not  tolerate 
errors . 


The  Learning  Difficulty  definitions  may  depend  too  much  on  maintaining 
rather  than  acquiring  proficiency.  Also  It  Is  not  clear  whether 
"Instruction"  in  2,  3,  and  4  Is  Intended  to  be  limited  to  description  or 
Includes  hands-on  practice.  Appendix  C  is  the  TVIV  Workbook. 

Perform  Ratings 

The  ratings  were  made  by  two  Independent  raters.  The  first  rater 
applied  each  TRAINYICE  model  to  all  four  devices;  the  second  rater  applied 
TRAINYICE  II,  III,  and  IV  to  all  four  devices  and  TVI  to  the  VIGS  only.  The 
rating  design  Is  shown  In  Figure  4.  Each  rater  familiarized  himself  with  the 
VIGS  device  by  practicing  a  prescribed  sequence  of  engagements  until  each 
felt  confident  enough  to  do  the  ratings.  The  two  raters  were  familiar  with 
the  remaining  three  devices  through  other  projects  and  refreshed  their 
memories  by  reviewing  the  particular  descriptions  in  DA  Pam  310-12  (1976). 


Device  Model 

VIGS 

BOT 

M55 

BRW 

TY-I 

Rater  1 

Rater  1 

Rater  1 

Rater  1 

Rater  2 

— — 

TV- 1 1 

Rater  1 

Rater  1 

Rater  1 

Rater  1 

Rater  2 

Rater  2 

Rater  2 

Rater  2 

TV-III 

Rater  1 

Rater  1 

Rater  1 

i 

Rater  1 

Rater  2 

Rater  2 

Rater  2 

Rater  2 

TV- IV 

Rater  1 

Rater  1 

Rater  1 

Rater  1 

Rater  2 

Rater  2 

Rater  2 

Rater  2 

Figure  4.  Rating  design  for  TRAINVICE  Workbooks 


RESULTS-PREDICTORS 


The  overall  TRAINVICE  scores  computed  for  raters  1  and  2  are  in 
Table  2.  The  scores  that  each  model  assigns  vary  greatly.  This  generates 
questions  concerning  what  relationship  a  value  for  a  particular  model  has 
when  compared  to  a  second  model  on  the  same  training  device.  For  example, 
rater  1  applying  TVI  awards  the  VI6S  device  .34,  but  the  same  rater  using 
TVII  awards  the  VI6S  .90.  Of  particular  concern  is  the  difference  between 
TV  III  and  TVIV.  The  scores  assigned  by  each  of  the  models  are  quite  dif¬ 
ferent  from  one  another  (e.g.,  where  the  two  raters  using  TV  III  assign  a  .38 
and  .41  for  the  YIGS  device,  the  TVIV  scores  are  .67  and  .74).  However,  the 
data  recorded  in  the  workbooks  for  these  two  devices  are  identical .  The  only 
difference  between  the  two  models  is  in  the  equati on  each  one  uses.  Further¬ 
more,  the  TVIV  scores  for  the  last  two  devices  (M55  and  BRW)  differ  greatly 
between  the  raters  whereas  for  TVII  I  both  raters'  scores  are  alniost  identi¬ 
cal.  Again,  since  the  only  difference  between  the  two  models  is  the  equation 
each  uses,  these  results  raise  some  interesting  questions  about  the  equations 
each  of  the  four  models  uses  to  produce  a  "prediction  value."  The  issue  of 
the  relationships  of  values  from  one  model  compared  to  another  model  is 
presented  In  the  Discussion  section. 

Although  the  actual  scores  which  each  TRAINVICE  model  assigns  are  dif¬ 
ferent,  the  rank  order  of  these  scores  produces  a  fairly  consistent  pattern. 
Figure  5  illustrates  this  by  displaying  each  of  the  TRAINVICE  scores  in 
relation  to  one  another  for  each  rater.  Figure  6  compares  the  pattern  of  the 
TRAINVICE  scores  for  each  rater  (with  the  exception  of  TVI  in  which  only 
rater  1  completed  the  analysis).  In  general,  the  patterns  of  the  scores  are 
similar  between  the  raters.  In  fact,  the  actual  TRAINVICE  scores  (presented 
In  Table  2)  are  not  considerably  different  between  raters  (with  the  exception 
of  TVIV  on  the  M55  and  BRW  devices). 

There  was  a  high  degree  of  agreement  among  the  predictions  generated  by 
the  four  TRAINVICE  models,  for  each  of  the  raters.  The  statistic  used  to  re¬ 
flect  this  multiple  correlation  was  Kendall's  Coefficient  of  Concordance  (W) 


RATER  1 


Figure  5.  TRAINVICE  Scores  in  Relation  to  Each  Other 
(By  Rater  By  Device) 


(Siegel,  1956)  which  took  into  account  the  rank  ordering  of  each  model's 
predictions  across  the  four  training  devices  in  question.  For  rater  1,  W  = 
.85  (p  <  .01).  Since  rater  2  had  only  applied  TVII,  TV  1 1 1 ,  and  TVIV  to  all 
four  devices,  his  coefficient  of  concordance  (.63)  was  less  reliable;  p  < 
.15.  The  immediate  implication  of  these  results  is  that  perhaps  the  simplest 
prediction  method  (TVII)  Is  the  one  to  use  since  Its  predictions  agree  with 
the  more  complicated  methods. 

Since  inter-rater  agreement  was  high  for  the  TRAINVICE  Indices,  we 

wanted  to  see  if  the  raters  agreed  consistently  throughout  the  rating 
procedure.  There  are  two  reasons  for  this:  (1)  If  the  raters  are  not 
agreeing,  then  an  analysis  of  rater-agreement  will  pinpoint  areas  in  the 
model  that  need  to  be  more  specific  in  defining  their  rating  criteria;  and 
(2)  If  the  raters  are  not  agreeing,  then  one  must  question  whether  the 

TRAINVICE  model  Is  producing  an  accurate  measure. 

To  Indicate  the  extent  to  which  raters  produced  similar  ratings,  a 
simple  "percent-agreement"  score  was  computed  for  each  of  the  component 
variables  of  each  TRAINVICE  model.  These  are  displayed  in  Table  3.  Tufano 
and  Evans  (1982)  designed  the  framework  of  this  table  to  show  the 

commonalities  among  the  four  models  in  terms  of  their  various  analyses.  In 

observing  the  rater  agreement  within  these  variables,  particular  areas  have 
produced  consistent  degrees  of  rater  agreement  across  all  of  the  TRAINVICE 
models.  Specifically,  In  the  coverage  of  commonality  analysis,  rater 
agreements  are  generally  80-100*.  In  the  learning  and  training  technique 
analysis,  rater  agreements  are  generally  below  50*. 
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METHOD-DATA  COLLECTION 


Plan 


The  data  collection  plan  was  to  give  a  set  of  Armor  OSUT  soldiers 
specific  opportunities  to  practice  gunnery  tasks  on  the  VI6S  rather  than  the 
normal  OSUT  gunnery  training.  Their  subsequent  dry  fire  performance  with  the 
M55  laser  on  two  engagements  each  from  Tank  Tables  II  (night)  and  III  (night) 
would  be  compared  with  the  performance  of  another  set  of  Armor  OSUT  soldiers 
who  had  normal  OSUT  gunnery  training  and  no  practice  on  the  VIGS.  Perform¬ 
ance  of  each  group  would  also  be  compared  with  performance  predicted  by 
TRAINVICE  ratings.  The  VIGS  training  was  presented  at  two  levels  of 
Intensity,  a  high  and  low  level. 

Subjects  » 

Twenty-nine  soldiers  from  one  OSUT  company  and  28  from  another  partici¬ 
pated.  They  were  represented  in  three  groups,  as  follows: 

Normal  OSUT 

Company  Gunnery  Low  VIGS 

B41  10  10 

D21  9  10 

Training  Method 

Subjects  In  the  high  and  low  level  training  groups  were  given  training 
as  described  In  Hoffman  and  Mel  chi ng  (1982).  Essentially,  the  two  levels  of 

r 

VIGS  training  were  substituted  for  a  portion  of  regular  OSUT  training  on  the 
M5S  laser.  The  high  group  was  administered  two  VIGS  training  modules;  the 
low  group,  was  administered  one  module. 

Module  1  training  on  the  MK60  for  both  high  and  low  level  groups 
occurred  during  week  ten  of  training.  It  was  substituted  for  approximately 
eight  hours  of  the  time  normally  devoted  to  training  on  Tank  Tables  I,  II, 
and  III  (Day  Fire)  using  the  M55  laser  mounted  on  turret  trainers.  Subjects 
who  were  assigned  to  high  level  training  returned  two  weeks  later  for  Module 
2  training.  The  training  module  was  scheduled  for  five  hours  and  occurred 


High  VIGS 


9 

9 


immediately  after  subjects  had  received  their  .22  caliber  Brewster  device 
exercises.  All  groups  had  training  on  the  burst-on-target  (BOT)  trainer. 


A  list  of  the  engagements  on  the  VIGS  is  shown  in  Table  4.  A  sample 
training  module  used  by  Hoffman  and  Melching  (1982)  is  presented  as  Figure  7. 


Testing  Method 

All  subjects  fired  Tank  Tables  II  (night)  and  III  (night).  The 
description  of  Tank  Table  II  (night)  is  as  follows: 


Task:  Employ  BOT  method  of  adjustment  (Engagements  1  and  4) 

Conditions:  Using  a  sub-caliber  (laser)  device,  the  Gunner  will 
adjust  fire  from  a  first  round  miss,  using  BOT  method  of  adjustment. 
Gunner  fire  at  stationary  targets  from  a  stationary  tank  under  White 
light  or  IR. 

Standards:  Gunner  must  hit  target  with  second  round  and  use  correct 
adjustment  techniques  to  qualify  on  Table  II  (night). 

Equipment  Set-up:  An  elevation  error  is  induced  into  the  computer 
to  cause  a  first  round  miss  requiring  fire  adjustment. 


The  description  of  Tank  Table  III  (night)  is  as  follows: 


Task:  Employ  80T  method  of  adjustment  (Engagements  1  and  3). 

Conditions:  Using  a  sub-caliber  (laser)  device,  the  Gunner  will 
adjust  fire  from  a  first  round  miss,  using  BOT  method  of  adjustment. 
Gunner  will  fire  at  moving  targets  from  a  stationary  tank  under  white 
light  or  IR. 

Standards :  Gunner  must  hit  targets  with  second  round  and  use  correct 
adjustment  techniques  to  qualify  on  Table  III  (night). 

Equipment  Set-up:  An  elevation  error  Is  Induced  Into  the  computer 
to  cause  a  first  round  miss  requiring  fire  adjustment. 


TABLE  4 


TARGET  CHARACTERISTICS  AND  AMMUNITION  IN  THE  20  VIGS  ENGAGEMENTS 


Target  Target  Target  Target 

Type  Range  Movement  Cover  Ammo 


Tank 

456 

Closing 

No 

HEAT 

Tank 

500 

Closing 

No 

HEAT 

Tank 

1000 

Closing 

No 

HEAT 

Tank 

1030 

Closing 

No 

APC 

800 

Closing 

No 

HEP 

Tank 

500 

Crossing 

No 

HEAT 

Tank 

1000 

Crossing 

No 

Tank 

406 

Closing 

Yes  i 

Tank 

588 

Cl  os i  ng 

Yes 

2  Tanks 

456 

Closing 

No 

HEAT 

APCk 

1326 

Crossing 

No 

HEAT 

2  Tanks 

1400 

Closing 

No 

APCk 

1130 

Crossing 

No 

HEP 

Tank 

1200 

Crossing 

No 

HEAT 

Tank 

1130 

Closing 

Yes 

HEAT 

Tank 

500 

Crossing 

Yes 

Tank 

1430 

Crossing 

No 

2  Tanks 

1230 

Crossing 

No 

HEAT 

Tank 

1300 

Crossing 

Yes 

HEAT 

2  Tanks 

1230 

Crossing 

No 

HEAT 

28 


BAT 

Module  1 

MK60  VIDEODISC  SIMULATOR 
GUNNERY  TRAINING 


Partial  Substitute  for  Lesson  Plan  GC050 

MK60  Training  in  Lieu  of  TANK  TABLES  I,  II,  and  III  (Day) 

A.  Administrative  Instructions: 

1.  When  training  will  be  given:  During  time  Tank  Tables  I,  II,  and  III 
(Day)  training  is  normally  given. 

2.  Training  location:  SK  Hall 

3.  Who  will  be  trained:  Sixteen  (16)  men,  8  from  2  platoons.  List  of 
selected  personnel  will  be  provided  by  ARI  R<SD  Coordinator. 

4.  Instructors:  Four  (4)  Assistant  Instructors/Tank  Commanders 

(AI/TC),  one  for  each  MK60  device.  ' 

5.  Training  Aids: 

(a)  Four  MK60  simulators,  regular  and  BOT  floppy  discs,  and 
videodisc. 

(b)  Practice  Monitor  Forms. 

6.  References: 

(a)  FM  17-12  w/changes  1  and  2 

(b)  FM  17-12-2  w/changes  1  and  2 

(c)  Lesson  Plan  GC050 

(d)  MK60  Gunnery  Trainer  Operator's  Manual 

(e)  Training  Objectives  and  Videodisc  Specifications  for  use  with 

the  frerceptronics  Videodisc  feunnery  Simulator,  ARI/HumRRO, 
January  1982.  * 

B.  Training  Objectives:- 

TASK:  Perform  the  steps  required  of  the  M60A1  tank  gunner  using  the 
MK60  simulator. 

CONDITIONS:  Given  a  functioning  MK60  simulator,  standard  and  BOT  floppy 
discs,  MK60  kill  zone  set  at  100*,  and  the  twenty-problem 
videodisc. 

STANDARDS:  Achieve  the  level  of  performance  stated  below  for  each 
intermediate  objective. 


Figure  7.  Sample  Training  Module 


Each  soldier  was  permitted  two  rounds  for  each  engagement.  As  noted, 
the  lesson  plan  requires  the  Tank  Commander  to  induce  an  elevation  error  into 
the  computer.  The  purpose  of  inducing  the  error  is  to  cause  a  first-round 
miss  so  the  soldier  will  be  required  to  apply  the  BOT  method  of  adjustment 
for  the  second  round. 

Tank  Commanders  scored  for  each  engagement  YES  or  NO  for  the  following 
behavioral  elements  corresponding  to  the  task  "hit  moving  target": 

1.  Correct  ammunition  indexed. 

2.  Main  gun  switch  on. 

3.  Announces  identified. 

4.  Correct  lead  (only  for  the  two  Table  III  moving  target  engagements). 

5.  Announces  on  the  way. 

6.  Hits. 

7.  Senses  -  BOT. 

8.  Re-lays. 

9.  Announces  on  the  way. 

10.  Hits. 

Figure  8  is  a  sample  score  sheet. 


RESULTS-DATA  COLLECTION 


I 


Table  5  is  the  raw  data  for  all  behavioral  elements  for  each  Company 
(B41  and  021).  "Lead"  scores  were  not  collected  on  tank  gunnery  Table  II 
since  stationary  tank-stationary  target  engagements  require  no  lead.  The  raw 
data  for  selected  behavioral  elements  were  combined  by  companies  (but  kept 
separate  by  gunnery  Table)  and  converted  to  percents  (Table  6).  The  percent 
YES  for  these  behavioral  elements  is  shown  on  the  graph  at  Figure  9.  Other 
behavioral  elements  were  not  examined  as  they  appear  on  inspection  of  the  raw 
data  to  be  successfully  performed  by  all  three  groups.  The  elements  examined 
and  not  examined  are: 


Examined 

Leads 

Hits 

Senses-BOT 

Re-lays 

Hits 


Not  Examined 
Index  ammo 
Main  gun  on 
Say  "Identified" 
Say  "On  the  Way" 
Say  "On  the  Way" 


The  TRAINVICE  scores  computed  earlier  for  rater  1  are  below.  Since  TVI 
ratings  were  Incomplete  for  rater  2,  his  ratings  were  not  used  in  the 
comparison.  One  would  expect  the  normal  OSUT  gunnery  group,  with  the  benefit 
of  M55  laser  day  firing,  to  do  better  on  the  M55  laser  night  firing  than 
either  the  low  VIGS  or  high  VIGS  which  did  not  have  M55  laser  day  firing. 
That,  at  least.  Is  what  the  TRAINVICE  scores  predict.  That  did  not  happen 
across  the  board  (see  Figure  9).  Only  on  "Leads,"  did  the  normal  OSUT 
training  group  perform  more  successfully  than  the  High-  and  Low-VIGS  groups. 
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NO  Raw  data  for  all  behavioral  elements 
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'Table  _6 

Raw  data  for  selected  behavioral  elements,  both  companies  (D21 ,  B41)  combined 


In  all  other  cases,  except  Re-Lays  (Tank  Gunner  Table  II)  and  Hits 
(first  round.  Tank  Gunnery  Table  III),  the  normal  OSUT  training  group  did 
better  than  only  one  of  the  VIGS  groups  (usually  the  High  group).  On  Re-Lays 
(Tank  Gunnery  Table  II)  and  Hits  (first  tround.  Tank  Gunnery  Table  III),  both 
the  high  and  low-VIGS  groups  did  better  than  the  normal  OSUT  training  group. 

The  low-YIGS  group  tended  to  perform  better  than  the  high-YIGS  group. 
An  exception  to  this  is  that  the  high  group  did  better  than  the  low  group  on 
both  first  and  second  round  hits  on  Tank  Gunnery  Table  III. 


DISCUSSION 


With  the  exception  of  TVIV  scores  on  M55  and  BRW  the  TRAINVICE  scores 
were  not  considerably  different  between  raters  1  and  2  (see  Table  2).  Since 
two  Independent  raters  produced  similar  results*  one  could  assume  that  the 
TRAINVICE  Indices  are  reliable  measures.  However,  In  observing  the  component 
variables  of  each  TRAINVICE  model  It  was  found  that  Inter-rater  agreement  was 
actually  low  for  particular  classes  of  variables  within  each  of  the  models; 
specifically,  the  learning  and  training  technique  variables  (see  Table  3). 
These  classes  of  variables  require  the  rater  to  use  more  subjective  judgment 
than  the  coverage  requirement,  commonality,  and  physical /functional 
similarity  variables  (which  all  produced  high  Inter-rater  reliability). 
Thus,  Increased  subjectivity  required  by  the  analysis  results  In  decreased 
reliability  of  the  ratings. 

i 

Empirical  data  were  collected  In  order  to  relate  the  predictor  estimates 
to  the  criterion  measures  (transfer  data).  The  challenge  In  relating  the 
predicted  transfer  of  the  criterion  measures  lies  In  the  nature  of  the 
transfer  Index.  TRAINVICE  (In  Its  various  forms)  produces  an  Index  that 
ranges  between  0  and  1;  higher  Index  values  within  a  model  predict  higher 
transfer.  The  values  "look  like"  percentages  and  If  they  were  one  could 
hypothesize  that  criterion  scores  would  produce  significant  differences  In 
the  same  direction  as  the  transfer  values.  Unfortunately,  the  transfer 
scores  are  not  percentages  of  any  other  measure  for  which  the  distribution  is 
known.  Thus,  one  would  be  hard-pressed  to  design  a  statistical  test  for 
transfer  Indexes. 

What  one  gets  from  the  repeated  applications  by  a  number  of  users  to  a 
number  of  training  devices  Is  the  start  of  data  that  ultimately  will  show  the 
distribution  of  the  Index.  Then,  one  can  rank  order  the  Indices  and  the 
criterion  results  and  apply  distribution-free  tests  such  as  rank  correlation 
coefficients.  Then,  one  can  determine  whether  apparent  differences  In 
transfer  Index  values  are  assocl;  >d  with  practical  differences  (In  the  same 
direction)  In  the  criterion  scores. 
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The  results  of  the  data  collection  Indicate  the  difficulties  inherent  in 
collecting  criterion  data  when  one  does  not  have  nearly  absolute  control  of 
the  data  collection.  Personnel  in  charge  of  inducing  elevation  error  into 
the  computer  routinely  failed  to  do  so.  The  data,  uniformly  for  each 
behavioral  element,  are  without  variance.  One  Is  hard-pressed  to  imagine 
OSUT  gunners  who  would  perform  as  well  if  conditions  were  better  controlled 
and  scorers  were  more  objective. 

Recommendations 

Problems  remain.  Some  are  practical  and  reasonably  easy  to  solve.  For 
example,  consider  the  problem  of  increasing  the  reliability  of  the  predictor 
measurement.  Boldovici,  Osborn,  and  Harris  (1977)  assert  that  one  can 
Increase  measurement  reliability  by  manipulating  systematic  variations 
Introduced  in  the  variables.  In  this  case,  variations  are  apparently  present 
In  the  kinds  of  Instructions  given  to  the  raters,  i.e.,  the  specificity  of 
the  instructions  and,  perhaps,  the  amount  of  practice  given  to  the  raters  for 
using  the  procedure. 

By  Increasing  the  specificity  of  the  instructions,  one  can  increase  the 
measurement  reliability.  Furthermore,  by  giving  the  rater  a  well  defined 
standard  stimulus  for  rating  and  requiring  the  rater  to  make  a  comparative 
rather  than  an  absolute  judgment,  performance  will  be  more  reliable. 

Criterion  measurement  Is  another  problem  which  is  reasonably  easy  to 
solve.  Criterion  data  can  be  Improved  if  collected  in  laboratories  using 
simple  devices  rather  than  In  field  settings  using  complex  weapon  systems. 

Other  problems  are  more  conceptual  at  this  point  and  require  more 
thought.  As  an  example,  consider  the  issue  of  Intuitive  versus 
counterintuitive  predictions. 1  Figure  10  shows  possible  outcomes  of 


*The  authors  wish  to  thank  Or.  John  A.  Boldovici  for  the  conceptual 
framework  described  here. 


PREDICTED 


Figure  io.  Possible  Outcomes  of  transfer  Forecasting  as 

Functions  of  Similarity  Between  Compared  Devices,  and 
Compared  Devices,  and  Whether  Predictions  Match 
Observations  (^Improvement  Required  in  Model  or 
Measurement,  NS=No  Surprise,  S=Surprise). 


transfer  forecasting  of  similarity  between  compared  devices,  and  whether 
predictions  match  observations. 

The  four  cases  in  which  predictions  and  observations  do  not  match  (I  in 
z  the  figure)  are  not  particularly  Instructive.  They  show  something  is  wrong 
with  the  model  or  the  measurement,  but  not  which  one.  The  no  surprise  (NS) 
cases,  one  (low/dif/dif )  of  which  Is  hidden  In  the  figure,  are  those  In  which 

(a)  a  difference  In  transfer  Is  both  predicted  and  observed  for  dissimilar 
devices,  and  (b)  no  difference  In  transfer  Is  both  predicted  and  observed  for 
similar  devices.  One  could  argue  that  models  are  not  needed  to  predict  those 
kinds  of  results  (i.e.,  no  surprise).  The  two  S  (surprise)  cases  are  the 
interesting  ones.  In  which  (a)  a  difference  in  transfer  Is  both  predicted  and 
observed  for  similar  devices,  and  (b)  no  difference  In  transfer  Is  both 
predicted  and  observed  for  dissimilar  devices.  How  do  we  get  models  capable 
of  predicting  those  kinds  of  outcomes?  One  way  is  to  find  literature  In 
which  (a)  similar  devices  (or  treatments)  produced  dissimilar  transfer,  and 

(b)  dissimilar  devices  (or  treatments)  produced  similar  transfer  (research  on 
procedures  learning,  for  example).  Then  ask,  "What  characteristics  would  a 
model  have  to  have  to  produce  those  results?" 
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Task  C 


The  purpose  of  the  task  comnuna 1 i t y  analysis  is  to  describe  the  overlap 
in  training  content  between  the  operational  situation  and  the  training  device. 
Communality  is  said  to  exist  when  a  subtask  can  be  performed  and  practiced 
in  the  training  situation  (device)  and  in  the  operational  situation. 

Rate  each  subtask  on  the  following  two-point  scale: 


TASK  COMMUNAL  1T\  ANALYSIS 


Name  of  Task:  HIT  MOVING  TARGET 


SUBTASKS 

VIGS 

BOT 

M55 

1.  Gunner  indexes  ammunition. 

2.  Gunner  turns  on  main  gun  switch. 

3.  Gunner  announces  IDENTIFIED. 

Gunner  applies  lead  in  dlrectioi 
*  of  target  apparent  motion. 

Gunner  lays  crosshair  leadline 
*  at  center  of  target  vulnerabilii 

y 

6.  Gunner  makes  final  precise  lay. 

7.  Gunner  announces  ON  THE  WAY. 

g.  Gunner  fires  main  gun. 

9  Gunner  announces  sensing  and 
‘  BOT. 

10.  Gunner  relays  (BOT). 

LI.  Gunner  announces  ON  THE  WAY 
(BOT). 

- 

L2.  Gunner  fires  main  gun>i(B0T). 

Total  Number  of  l's 

Task  Communal ity  Index 

The  physical  similarity  analysis  deals  with  the  similarity  between 
physical  characteristics  of  the  training  device  and  those  of  the  operational 
situation.  The  assessment  is  based  on  the  physical  similarity  (such  as 
location,  appearance,  and  feel).  Ignore,  for  now,  the  amount  and  quality 
of  information. 

For  each  subtask,  rate  each  relevant  control  and  display  to  describe 
how  well  the  control  or  display  is  represented  in  the  training  device. 

Base  your  physical  similarity  ratings  on  the  following  four-point  scale: 


Rating 

3 


2 


1 


PHYSICAL  SIMILARITY  RATING  SCALE 


Definition 

Identical.  The  trainee  would  not  notice  a  difference  between 
the  training  device  control  or  display  and  the  operational 
control  or  display  at  the  time  of  transfer.  Note  that  they 
need  not  be  absolutely  identical,  but  there  must  be  no  notice¬ 
able  difference  for  the  trainee. 

Similar.  The  trainee  would  notice  a  difference  at  the  time 
of  transfer,  but  he  would  be  able  to  perform  the  task.  There 
might  be  a  decrement  ir\  performance  at  transfer,  but  any  such 
decrement  would  be  readily  overcome. 

Dissimilar.  There  would  be  a  large  noticeable  difference, 
quite  apparent  to  the  trainee  at  transfer,  and  a  large  per¬ 
formance  decrement,  given  that  the  trainee  could  perform  at 
all.  Specific  instruction  and  practice  would  be  required 
on  the  operational  equipment  after  transfer  to  overcome  the 
decrement. 


0 


The  control  or  display  is  not  represented  at  all  in  the  train¬ 
ing  device. 


REQUIRED  TASK 
CONTROLS (C)  AND  DISPLAY (D) 
BY  SUBTASK 
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REQUIRED  TASK  VIGS  BOT  M55  BRW  V/BRW  M60A1 

CONTROLS (C)  AND  DISPLAY (D)  Sim*  (Sub task  Sim*iSubtask  Sim*iSubtask  Sim* iSubtask  Sim*  iSubtask  Sim*jSubtas 


Similarity 


Functional  Sinilaritv  Analysis 


The  functional  similarity  analysis  is  based  on  the  numbers  of  alternatives 
which  each  display  or  control  may  assume.  The  alternatives  in  the  device  are 
compared  with  the  alternatives  in  the  operational  system. 

For  each  display  and  control,  first  determine  the  number  of  alternatives 
in  the  operational  environment.  This  is  often  a  straight-forward  decision. 

For  example,  the  ammunition  index  handle  on  the  computer  of  an  operational  tank 
has  six  positions.  You  should  enter  a  ”6"  on  the  worksheet.  But  sometimes 
there  are  an  indeterminant  number  of  alternatives.  For  example,  a  target  may 
be  moving  in  any  of  360  directions  at  up  to  35  different  speeds.  In  these 
cases  use  your  expertise  to  identify  the  number  of  states  (direction  by  speed) 
that  change  the  procedure  (in  this  case,  initial  sight  picture)  for  the  task. 

Next  determine  the  number  of  alternatives  in  the  training  device.  Do 
not  consider  the  similarity  between  the  device  and  the  operational  environment. 
Even  if  the  computer  on  the  device  has  buttons  instead  of  a  handle,  enter  the 
number  of  alternatives  presented  by  the  buttons.  Try  to  base  your  estimate 
of  indeterainant  cases  on  the  known  alternatives  the  devices  present.  If  the 
alternatives  for  the  device  are  unknown,  consider  the  number  of  alternatives 
possible  within  the  inherent  constraints  of  the  device. 

i  Repeat  the  process  for  each  display  and  control  for  each  subtask.  The 

f  number  of  alternatives  for  a  given  control  or  display  may  vary  depending  on  the 

[  sub task. 
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The  benefits  ci  a  training  device  depends  in  part  on  the  level  of  perform¬ 
ance  the  trainee  would  probably  have  before  formal  training  and  the  level  he 
would  need  to  perform  the  task  in  the  operational  environment.  The  learning 
deficit  analysis  addresses  that  relationship.  This  analysis  requires  you  to 
perform  three  procedures: 

.  Rate  the  level  of  the  skills  and  knowledge  related  to  the 
task  that  the  trainee  would  probably  have  prior  to 
training. 

.  Determine  the  level  of  skills  and  knowledges  the  trainee 
would  need  to  perform  the  cask. 

.  Estimate  the  amount  of  time  required  to  train  the  skills 
and  knowledges  to  the  level  required  by  the  task. 

First  estimate  the  amount  of' each  skill  or  knowledge  the  average  trainee 
would  have  upon  his  first  exposure  to  the  training  system.  In  this  case  the 
average  trainee  is  a  high  school  graduate  in  Armor  OSUT.  He  has  completed 
the  common  soldier  and  the  tank  driver  blocks  of  instruction.  Rate!  his  likely 
level  of  proficiency  on  each  skill  and  knowledge  on  the  following  five  point 
Repertory  Scale  (RS) :  , 


REPERTORY  SCALE 


■Rating  Definition 

4  Has  a  complete  understanding  of  the  skill  or  knowledge.  Can 

do  the  steps  in  this  subtask  that  require  the  skill  or  know¬ 
ledge  completely  and  accurately  without  supervision. 

3  Understands  this  skill  or  knowledge  but  may  require  super¬ 

vision  to  do  the  steps  in  this  subtask  that  require  the  skill 
or  knowledge.  Level  of  proficiency  equals  what  would  be 
expected  after  several  practice  trials  of  the  step. 

2  Is  familiar  with  this  skill  or  knowledge,  but  would  require 

assistance  on  the  steps  in  this  subtask  that  require  the  skill 
or  knowledge.  Level  of  proficiency  equals  what  would  be 
expected  from  a  complete  briefing  and  one  performance  of  the 
task  step. 

1  Has  a  limited  experience  or  familiarity  with  this  skill  or 

knowledge.  Level  of  proficiency  equals  what  would  be  expected 
from  an  orientation. 

0  No  experience  or  familiarity  with  this  skill  or  knowledge. 

Cannot  perform  a  cask  step  requiring  this  skill  or  knowledge. 


Next,  determine  the  amount  of  each  skill  and  knowledge  required  to  ntrfcr 
the  task.  In  this  case  the  task  requires  hitting  moving  targets  from  stationer; 
and  moving  tanks,  within  10  seconds,  70a  of  the  time.  Base  your  ratings  on  the 
following  five-point  Criterion  Scale  (CS): 

CRITERION  SCALE 


Definition 


Should  be  able  to  apply  skill  or  knowledge  under  all  conditions 
without  hesitation.  System  will  not  tolerate  errors. 

Should  be  able  to  apply  skill  or  knowledge  under  most  conditions 
without  hesitation.  System  will  not  tolerate  infrequent  errors. 

Should  have  skill  or  knowledge  equivalent  to  briefing  and  some 
practice  but  does  not  need  to  be  able  to  apply  knowledge  or 
skill  without  error.  System  will  tolerate  occasional  errors. 

Should  have  skill  or  knowledge  equivalent  to  briefing  on 
knowledge  or  on  performance  of  skill.  System  will  tolerate 
frequent  errors. 


The  last  factor  for  the  Learning  Deficit  Analysis  is  the  amount  of  time 
that  would  be  required  to  train  a  person  to  the  required  CS  level  for  each 
sub task.  Assume  that  all  training  will  be  performed  dry-fire  on  a  tank. 
Targets  will  be  8'  x  8'  panels  on  a  track.  For  each  subtask  list  the  number 
of  minutes  required  under  those  conditions  to  take  a  trainee  from  his  entry 
(RS)  level  to  the  required  (CS)  level. 


Rating 

4 

3 

2 

1 


KNOWLEDGES  AND  SKILLS 
BY  SUBTASK 


Criterion 


Minutes 
To  Train 


1.  GUNNER  INDEXES  AMMUNITION. 

Ki  Knows  procedure  to  index  ammunition  (including 
when  to  index  ammunition) 

2.  GUNNER  TURNS  ON  MAIN  GUN  SWITCH 
(None) 

3.  GUNNER  ANNOUNCES  IDENTIFIED 

K2  Knows  that  saying  IDENTIFIED  is  response  to  TC 
saying  GUNNER,  (AMMO  TYPE),  (TARGET  TYPE)  and 
Gunner  seeing  the  target 

Si  Is  able  to  distinguish  between  targets  and 
friendlies 

4.  GUNNER  APPLIES  LEAD 

K3  Knows  number  of  lead  lines  for  anmunitlon 
types 

1 

K4  Knows  number  of  lead  lines  for  speed  of  target 

S2  Is  able  to  estimate  speed  of  target 

So  Is  able  to  maintain  smooth  track 

5.  GUNNER  LAYS  CROSSHAIR  LEADLINE 

K5  Knows  crosshair  leadline  is  placed  on  target's 
center  of  mass  (with  lead  applied) 

■-= — 

S3  Is  able  to  maintain  smooth  track 

6.  GUNNER  MAKES  FINAL  PRECISE  .AY 

K5  Knows  crosshair  leadli  is  placed  on  target's 
center  of  mass  (with  lead  applied) 

S3  Is  able  to  maintain  smooth  track 

7.  GUNNER  ANNOUNCES  ON  THE  WAY 

K6  Knows  that  saying  ON  THE  WAY  is  response  to 
crosshair  leadline  being  on  target's  center  of 
mass,  TC  saying  FIRE,  and  Loader  saying  UP 

S3  Is  able  to  maintain  smooth  track 

8.  GUNNER  FIRES  MAIN  GUN 

53  Is  able  to  maintain  smooth  track 

9.  GUNNER  ANNOUNCES  SENSING  AND  BOT 

K7  Knows  that  sensing  is  mental  notation  of  the 
point  in  the  sight  reticle  where  burst  of  round 
appears  as-it  passes, .  strikes  short  of,  or  hits 
the  target. 

Kg  Knows  there  are  three  deflection  sensings 
(LEFT,  RIGHT,  LINE)  and  four  range  sensings 
(SHORT,  OVER,  DOUBTFUL,  TARGET) 

K9  Knows  that  saying  BOT  is  response  to  sensing 
round 

54  Is  able  to  sense  rounds 

LEARNING  DEFICIT  ANALYSIS 
(Continued) 


KNOWLEDGES  AND  SKILLS 

_ BY  SUBTASK _ _ 

10.  GUNNER  RELAYS  (BOT) 

K^o  Knows  to  move  point  of  sight  reticle  by 
most  direct  route  from  where  burst  of  round 
appears  to  target's  center  of  mass 

52  Is  able  to  estimate  speed  of  target 

53  Is  able  to  maintain  smooth  track 

11.  GUNNER  ANNOUNCES  ON  THE  WAY  (BOT) 

Kn  Knows  that  saying  ON  THE  WAY  is  response 
to  point  of  sight  reticle  where  burst  of  round 
appears  being  on  target's  center  of  mass  and 
Loader  saying  UP 

S3  Is  able  to  maintain  smooth  track 

12.  GUNNER  FIRES  MAIN  GUN  (BOT) 

S3  Is  able  to  maintain  smooth  track 


Training  Techniques  Analysis 


This  part  of  the  analysis  considers  the  adequacy  of  the  training 
techniques  possible  on  the  training  device.  Complete  a  worksheet  for  each 
subtask.  First,  decide  which  taxonomic  categories  apply  to  the  subtask.  The 
categories  are  defined  and  illustrated  in  Table  1  of  this  appendix.  Several 
categories  may  apply  to  a  subtask. 

Next  rate  the  extent  to  which  the  principles  relevant  to  the  categories 
have  been  incorporated  in  the  device.  The  principles  relevant  to  each  category 
have  already  been  Identified  on  each  worksheet.  Rate  each  principle  in  each 
category.  The  principles  are  defined  and  illustrated  in  each  category.  The 
principles  are  defined  and  illustrated  in  Appendix  A  of  this  workbook.  Base 
your  ratings  on  the  following  seven-point  scale: 


TRAINING  TECHNIQUE  SCALE 


Rating 

3 


-1 

-2 

-3 


Definition 

-  , 

Optimal  implementation  of  this  technique;  in  complete 
accord  with  this  principle. 

Good  implementation  of  this  technique;  in  excellent 
accord  with  this  principle. 

Fair  implementation  of  this  technique;  good  accord 
with  this  principle. 

This  priinclple  or  technique  was  inapplicable  or 
irrelevant. 


or 


The  device  neither  implemented  this  technique  nor 
violated  this  principle. 

Mild  violation  of  this  training  ^rincipls; 
implementation  of  a  mildly  opposing  technqiue. 

Serious  violation  of  this  principle  or  technique. 

Complete  violation  of  this  principle;  implementation 
of  a  strongly  contraindicated  technique. 


Training  Techniques  Analysis 


This  part  of  the  analysis  considers  the  adequacy  of  the  training 
techniques  possible  on  the  training  device.  Complete  a  worksheet  for 
each  subtask.  First,  decide  which  taxonomic  categories  apply  to  the 
subtask.  The  categories  are  defined  and  illustrated  in  Table  1. 
Several  categories  may  apply  to  a  subtask. 

Next  rate  the  extent  to  which  the  principles  relevant  to  the 
categories  have  been  incorporated  in  the  device.  Rate  each  principle 
in  each  category.  The  principles  are  defined  and  illustrated  in 
Appendix  A.  Base  your  ratings  on  the  following  seven-point  scale: 


TRAINING  TECHNIQUE  SCALE 


Rating  Definition 

3  Optimal  implementation  of  this  technique;  in  complete  accord 

with  this  principle. 

2  Good  implementation  of  this 

with  this  principle. 

1  Fair  implementation  of  this 

principle. 

0  This  principle  or  technique 

or 

The  device  neither  implemented  this  technique  nor  violated 
this  principle. 

-1  Mild  violation  of  this  training  principle;  implementation 

of  a  mildly  opposing  technique. 

-2  Serious  violation  of  this  principle  or  technique. 

-3  Complete  violation  of  this  principle;  implementation  of  a 

strongly  contraindicated  technique. 


technique;  in  excellent  accord 
technique;  good  accord  with  this 
was  inapplicable  or  irrelevant. 


TRAINING  TECHNIQUES  ANALYSIS 


Subrask:  GUNNER  INDEXES  AMMUNITION 


Task-Taxonomic 

Label 


PRINCIPLES  - 


< 

Res 

Ra 

□  1.  Recalling 

far r c  anH 


facts  and 
principles 


□  2.  Recalling 
procedures 


□  3.  Non-verbal  10 
identifi-  11 


cation 


1  I  4 .  Non-verbal  13 
• — '  detection  14 


□  5.  Using  15 

principles  16 
inter-  36 

preting, 
inferring 


I  I  6.  Making 
' — ’  decisions 


TECHNIQUES 


Feedback  9  Ratine 


TRAIN! N 


analysis 


Subcask:  GUNNER  INDEXES  AMMUNITION 

.  i 


Task-Taxonomic 

Label 


|  1  7 .  Continuous  22 
‘ — '  movement  23 


PRINCIPLES  - 


Res 

Ra 

TECHNIQUES 


Feedback  Ratine 


I  I  8.  Verbal 
I — '  detection 


and  identi-  5 
fication  26 


I  1 9.  Position- 
■ — *  ing  and 

serial 


movement 


techniques  .analysis 


Subtask:  GUNNER  INDEXES  AMMUNITION 


Task-Taxonomic 

Label 


PRINCIPLES 


Stimulus  II  Ratine  Res 


TECHNIQUES 


Feedback  il  Rat  in 


I  1  10.  Repetitive  29 
* — *  movement  30 

31 

35 


1  1  11.  Written 

* — '  verbali¬ 

zation 

32 

33 

[“I  12 .  Oral 

29 

1 — 1  verbali- 

zation 

I”!  13.  Other 

33 

’ — *  verbali- 

34 

zation. 

including 

signs 

rr.cn:; loiTi 


Sub r ask:  GUNNER  TURNS  ON  MAIN  GUN  SWITCH 


Task-Taxonomic 

Label 


□  1.  Recalling 
facts  and 
principles 


□  2.  Recalling 
procedures 


PRINCIPLES  -  TECHNIQUES 


sA 

Response  ll  Rat  in 

n 

Feedback,  ii  Rat  in 

□  3.  Non-verbal  10 

ident-ifi-  11 


identifi-  11 
cation  12 

35 


□  4.  Non-verbal  13 
detection  14 


□  5.  Using  15 

principles  16 
inter-  36 

preting, 
inferring 


I  I  6.  Making 
‘ — ’  decisions 


Subtask:  GUNNER  TURNS  ON  MAIN  GUN  SWITCH 


Task-Taxonomic 

Label 


PRINCIPLES  -  TECHNIQUES 


Stimulus  ii  Ratine  Response 


Ratine  I  Feedback  ii  Rat  in 


f 17.  Continuous 
* — '  movement 


1  1  8.  Verbal 

2 

' — '  detection 

4 

and  identi- 

5 

fication 

26 

1  1  9.  Position- 

27 

* — ■  ing  and 

28 

serial 

35 

movement 

36 

lAi  *-■  *>»  *>.*.*.*  *.t 


Subtask:  GUNNER  TURNS  ON  MAIN  GUN  SWITCH 


Task -Taxonomic 
Label 


PRINCIPLES  -  TECHNIQUES 


|  I  10.  Repetitive 

29 

* — *  movement 

30 

31 

35 

1  j 11.  Written 

32 

' — *  verbal!- 

33 

zation 

HI  12.  Oral 

29 

' — '  verbali- 

zation 

|~|  13.  Other 

33 

' — *  verbali- 

34 

zation. 

including 

signs 

8 

ResDonse  j 

•  Rat  in 

7\ 

Feedback  P  Rat  in 

(Wi 


S"  >*.  «|Vk»  St 


.vSrlv 


w 


'  </ V  js' "In  V  • 


WWfl 


5 


66 


f-jSm  .i|  J’l  »*  !i  *46  ■»«<  #  •■.  -*  !-■  K.»  <„#  >tg  ..aI,'— I 


i i .» x  .•  v 


;:::;  iques  analysis 


Svii':  :  GUNNER  ANNOUNCES  IDENTIFIED 


Task-Taxonomic 

Label 


I  1 1.  Recalling 
' — *  faces  and 

principles 


□  2.  Recalling 
procedures 


PRINCIPLES  -  TECHNIQUES 


Stimulus  H  Rating  |  Response 


Ratine  Feedback  i1  Ratine 


□  3.  Non-verbal  10 
identifi-  11 


cation 


□  4.  Non-verbal 
detection 


□  5.  Using 

principles 

inter¬ 

preting, 

inferring 


I  I  6.  Making 
* — '  decisions 


Subtask:  GUNNER  ANNOUNCES  IDENTIFIED 
.  « 


VS  If. 


Subtask:  GUNNER  ANNOUNCES  IDENTIFIED 


Task-Taxonomic 

Label 


Repetitive  29 
movement  30 
31 
35 


□  11.  Written 
verbali¬ 


zation 


□  12.  Oral 

verbali¬ 


zation 


□  13.  Other 

verbali¬ 


zation, 

including 

signs 


PRINCIPLES  -  TECHNIQUES 


JJ4 


Response  1)  Ratine  Feedback  0  Rat  in 


,t  \Q£ 


■  l‘>  t  f. 


1 


S3 


i techniques 


Subtask:  GUNNER  APPLIES  LEAD 


Task-Taxonomic  _ _ PRINCIPLES  -  TECHNIQUES _ 

Stimulus  1!  Rating  Response  it  Rating  Feedback  i‘  Ratin 


|  1  1.  Recalling 

* —  facts  and 

principles 


□  2.  Recalling 
procedures 


□  3.  Non-verbal  10 
identifi-  11 


cation 


1  I  A .  Non-verbal 
* — •  detection 


□  5.  Using 

principles 

inter¬ 

preting, 

inferring 


Making 

decisions 


illlM 


.V«V»N  u'j 


Sub task:  GUNNER  APPLIES  LEAD 


Task-Taxonomic 

Label 


PRINCIPLES  -  TECHNIQUES 


Stimulus  if  Rating 


Response  £  Rating 


Feedback  (;  Rating 


□ 


7. 


Continuous 

movement 


22 

23 

24 

25 

35 

36 


10 

11 

17 

20 

22 

23 

24 

27 

28 
31 


9 

10 

15 

17 

19 

22 

23 
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11 
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35 
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9 

12 
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16 

17 
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19 
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23 
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26 

27 

28 

29 
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Subtask:  GUNNER  LAYS  CROSSHAIR  LEADLINE 
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Label 


□  1.  Recalling 
facts  and 
principles 


Recalling 

procedures 


PRINCIPLES  -  TECHNIQUES 


Stimulus 


Feedback  i1  Rat  in 


□  3.  Non-verbal  10 
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□  4.  Non-verbal 
detection 


□  S.  Using 

principles 

inter¬ 

preting, 

inferring 


□  6.  Making 

decisions 
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Response  r 
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22 

10 

9 

* 

' — '  movement 

23 

11 

10 

24 

17 
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25 

20 

17 

35 

22 

19 

36 

23 

22 

24 

23 

27 

24 

28 

25 

31 

26 

• 

27 

28 

29 

30  l 
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11 
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12 

29 
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5 
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26 
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27 

1 

9 
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28 

13 

12 
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35 

21 
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36 

23 
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24 

17 

25 

18 

27 

19 

28 

20 

31 

21 

22 

* 

23 

24 

26 

27 

28 

29 
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□  2.  Recalling 
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preting, 
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Sub task:  GUNNER  MAKES  FINAL  PRECISE  LAY 
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PRINCIPLES  -  TECHNIQUES 


Stimulus  //  Ratir.a  Resoonse  "  Rating  |  Feedback  1!  Ratin 


I  j  7 .  Continuous 
* — '  movement 


□  8.  Verbal 

detection 


Verbal  2 
detection  A 
and  identi-  5 
fication  26 


□  9.  Position¬ 
ing  and 
serial 


movement 


Subtask:  GUNNER  MAKES  FINAL  PRECISE  LAY 


Task-Taxonomic 

PRINCIPLES  -  TECHNIQUES 

Label 

Stimulus  /' 

Rating 

nan 

Feedback  P 

Rat inc 

|  1  10.  Repetitive 
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18 
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30 

20 
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31 

23 

17 

35 

24 

18 

25 

19 

27 

20 

28 

21 

31 

22 

23 

24 

26 

27 

28 
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30 
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32 

1 

13 

33 

9 

29 
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30 
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29 

14 

14 

15 

29 
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IS 

30 

22 
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33 

1 
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34 

9 

29 
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18 

30 
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r 
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Subtask:  GUNNER  ANNOUNCES  ON  THE  WAY 


Task-Taxonomic 

Label 


□  1.  Recalling 
faces  and 
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procedures 
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Subtask:  GUNNER  FIRES  MAIN  GUN 
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I  I  1.  Recalling 
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detection 


□  5.  Using 
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preting, 
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Subtask:  GUNNER  FIRES  MAIN  GUN 
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Task-Taxonomic 

Label 
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principles 
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detection  14 
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7.  Continuous 
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Subrask:  GUNNER  ANNOUNCES  ON  THE,  WAY  (BOT) 


Task-Taxononic 
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PRINCIPLES  -  TECHNIQUES 


Resoonse 

Feedback  » 

•  Ra 

□  1.  Recalling 

f art  K 


facts  and 
principles 


□  2.  Recalling 
procedures 


□  3.  Non-verbal  10 
identifi-  11 
cation  12 

35 


□  4.  Non-verbal  13 
detection  14 


□  5.  Using 

principles 
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preting, 
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Subtask:  GUNNER  ANNOUNCES  ON  THE  WAY  (BOT) 
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l — '  movement  30 

31 
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Task  -Taxonomic 
Label 


PRINCIPLES  -  TECHNIQUES 


Stiniulus  Rating 


Response  if  Rating 


Feedback  fl  Ratine 


□ 


1.  Recalling 
facts  and 
principles 


A 

3 

4 
3 


1 

2 

3 

26 

31 


1 

2 

27 

29 

30 
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2.  Recalling 
procedures 


2 

4 

5 

6 

7 

8 
9 


1 

2 

3 

26 

29 
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1 

2 

3 

29 

30 
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3.  Non-verbal 
identifi¬ 
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10 

11 

12 

35 


4 

5 

26 


1 

4 

5 
27 

29 
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6 

29 
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preting, 
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7 

27 

29 
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18 
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9 

17 

18 
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8 

29 
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Recalling  Facts  &  Principles 

a.  Common  behavior  attributes: 

1.  Concerns  verbal  or  symbolic  learning. 

2.  Concerns  acquisition  and  long  tern  maintenance  of  knowledge  so  that 
it  can  be  recalled. 

b.  Common  examples: 

1.  Recalling  equipment  nomenclature  or  functions. 

2.  Recalling  system  functions,  such  as  the  complex  relations  between 
system  input  and  output. 

Recalling  Procedures 

a.  Common  behavioral  attributes: 

1.  Concerns  verbal  or  symbolic  behavior. 

2.  Concerns  acquisition  and  long  term  maintenance  of  knowledge  so  that 
it  can  be  recalled. 

3.  Concerns  the  chaining  or  sequencing  of  events. 

b.  Common  examples: 

1.  Recalling  equipment  assembly  and  disassembly  procedures. 

2.  Recalling  the  operating  or  checkout  procedures  for  a  piece  of 
equipment  (Cockpit  check  lists) . 

Non-Verbal  Identification 

a.  Common  behavioral  attributes: 

1.  Pattern  recognition  approach  to  identification  -  not  problem 
solving. 

2.  Classification  by  non-verbal  characteristics. 

3.  Status  determination  -  ready  to  start. 

b.  Common  examples: 

1.  Classify  a  sonar  target  as  "sub”  or  "non-sub." 

2.  Visual  classification  of  flying  aircraft  as  "friend"  or  "enemy" 
or  as  an  "F-4." 

Non-Verbal  Detection 

a.  Common  behavior  attributes: 

1.  Vigilance  -  detect  a  few  cues  embedded  in  a  large  block  of  tine. 

2.  Low  threshold  detections  -  early  detection  of  very  small  cues. 

3.  Scan  for  wide  range  of  possible  cues.. 

b.  Common  examples: 

1.  Detect  targets  in  background  noise  on  radar/sonar  scopes. 

2.  Visually  detect  submarine  periscope  at  sea  (snorkeling) . 

Using  Principles,  Interpreting,  Inferring 

a.  Common  behavior  attributes: 

1.  Use  of  logic  and/or  natural  law,  and/or  known  relationships. 

2.  Limited  uncertainty  of  outcome. 

3.  Usually  little  thought  of  other  alternatives. 

4.  Usually  related  to  on-going  casks. 

b.  Common  examples: 

1.  Diagnosis  of  equipment  malfunctions  by  using  scientific  laws  or 
principles. 

2.  Dealing  with  the  impact  of  natural  forces  in  shiphandling  -  tides, 
currents,  weather,  momentum. 


. Ai  LI  1  (Cent  *c, ; 

Making  Decisions 

a .  Conxion  behavioral  attributes: 

1.  Choosing  a  course  of  action  when  alternatives  are  given,  unspeci: 
or  unknown. 

2.  A  successful  course  of  action  is  not  readily  apparent. 

3.  The  penalties  for  unsuccessful  courses  of  action  are  not  readily 
apparent. 

4.  The  relative  value  of  possible  decisions  must  be  considered  - 
including  possible  trade-offs. 

5.  Frequently  involves  forced  decisions  made  in  a  short  period  of 
time  with  soft  information. 

b.  Common  examples: 

1.  Choosing  frequencies  to  search  in  an  ECM  search  plan. 

2.  Choosing  torpedo  attack. 


Continuous  Movement 

a.  Common  Behavioral  Attributes: 

1.  Tracking,  dynamic  control:  a  perceptual-motor  skill  involving  con¬ 
tinuous  pursuit  of  a  target  or  keeping  dials  at  a  certain  reading 
such  as  maintaining  constant  turn  rates,  etc. 

2.  Compensatory  movements  based  on  feedback  from  displays. 

3.  Skill  in  tracking  requires  smooth  muscle  coordination ( patterns  - 
lack  of  overcontrol. 

4.  Involves  estimating  changes  in  positions,  velocities,  accelerations, 
etc. 

5.  Involves  knowledge  of  display-control  relationships. 

6.  May  involve  scanning  of  complex  displays  to  determine  current 
status  of  system,  and  to  predict  the  evolving  state  of  the  system. 

b.  Common  examples: 

1.  Submarine  bow  and  stern  planes  operators  maintaining  a  constant 
course,  or  making  changes  in  course  or  depth. 

2.  Tank  driver  following  a  road. 

Verbal  Detection  And  Identification 

a.  Common  behavioral  attributes: 

1.  Involves  the  recognition  of  symbols,  spoken  or  written  language, 
or  codes,  diagrams,  schematics,  technical  symbology,  etc. 

2.  Symbols  to  be  identified  typically  are  of  low  meaningfulness  to 
untrained  personnel. 

3.  More  cognitive  than  sensory  -  identification  or  interpretation  is  . 
emphasized. 

4.  Involves  storing  queues  of  symoblic  information  and  meanings  and 
the  recognizing  of  these  symbols  and/or  meanings. 

5.  Basic  components  of  most  tasks. 

b.  Common  examples: 

1.  Monitoring  communication  channels. 

2.  Reading  schematics  symbols. 


Positioning  And  Serial  Movement 

a.  Common  behavioral  attributes: 

1.  Positioning  switches,  push  buttons,  knobs,  levers,  etc.,  either 
individually  or  in  sequence. 

2.  Highly  coordinated  motor  tasks  such  as  key  board  operations. 

3.  Motor  aspects  of  equipment  set-up  and  operating  procedures. 

4.  Proprioceptive  feedback  is  Important. 

b.  Common  examples: 

1.  Following  equipment  turn-on  procedures  -  emphasis  on  motor  benavio: 

2.  Typing  or  operation  of  computer  terminal  -  card  punch  operation. 
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10.  Repetitive  Movement 

a.  Common  behavioral  attributes: 

1.  Perceptual-motor  behavior-emphasis  on  motor.  Premium  or.  manual 
dexterity,  occasionally  strength  and  endurance. 

2.  Repetitive  mechanical  skill. 

3.  Standardized  behavior,  little  room  for  variation  or  innovation. 

4.  Automatic  behavior,  low  level  of  attention  is  required  in  skilled 
operator.  Kinesthetic  cues  dominate  control  of  behavior. 

5.  Fatigue  or  boredom  may  become  a  factor  when  skill  is  performed 
over  an  extended  period  of  time  or  at  a  rapid  rate. 

6.  Fine  tolerances. 

7.  Often  a  component  of  a  larger  task. 

b.  Common  examples: 

1.  Use  of  hand  tools  such  as  hammer,  saw,  wrench  or  power  tools  such 
as  lathes,  or  grinders. 

2.  Running  a  drill  press  in  an  assembly  line. 

11.  Written  Verbalization 

a.  Common  behavioral  attributes: 

1.  Creating  an  alpha-numeric  statement.  > 

2.  Frequently  involves  use  of  a  formal  or  special  language  such  as 
used  to  input  data  into  a  computer. 

3.  Less  spontaneous  than  oral  communication;  more  time  is  available 
to  construct  verbalization. 

4.  To  translate  an  event  into  an  alpha-numeric  description. 

b.  Common  examples: 

1.  Shipboard  log  keeping. 

2.  Status  board  updating. 

12.  Oral  Verbalization 

a.  Common  behavioral  attributes: 

1.  Speaking  natural  or  specilized  languages. 

2.  Often  involves  the  use  of  a  specific  message  model.  -  Standard 
vocabulary  and  format. 

3.  Also  concerns  clarity  of  voice,  enunciation,  speed,  volume,  etc. 

4.  Timing  of  verbalization  is  usually  critical  -  when  to  pass  infor¬ 
mation. 

5.  Typically  characterized  by  redundancy^ in  terms  of  information 
content. 

6.  Involves  extensive  use  of  previously  overlearned  verbal  skills, 
or  overcoming  overlearned  interfering  patterns. 

b.  Common  examples: 

1.  Officer  giving  oral  orders. 

2.  Sonar  operator  passing  oral  information  over  communication  net. 

13.  Other  Verbalization,  Including  Signs 
a.  Common  behavioral  attributes: 

1.  Communication  other  than  oral  or  written. 

2.  Use  of  sign  language  such  as  hand  signals. 


3.  Special  emphasis  on  the  motor  skill  required  to  execute  sign 
language  such  as  semaphore. 

Common  examples: 

1.  LSO  use  of  signals  to  communicate  with  pilot  making  carrier  lanai 

2.  traffic  police  directing  traffic  at  a  busy  intersection. 
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TRAILING  TECHNIQUES  AND  PRINCIPLES 

l 

Stimulus  Considerations 

1.  Organize  training  around  intrinsic  cue  components  (key  words,  formuli, 
or  key  letters)  within  the  fact  or  principle.  Use  these  cue  components 
as  mediators  to  trigger  recall  of  complete  facts  or  principles. 

2.  Use  mnemonics  (associating  recall  of  facts  or  principles  with  imagery, 
rhyme,  rhythm,  etc.). 

3.  Prevent  decay  of  recall  by  increasing  the  meaningfulness  of  the  material 

to  be  learned  by  providing  organization  to  the  related  facts  or  princi¬ 

ples. 

4.  Prevent  decay  of  recall  by  overlearning  the  original  material. 

5.  Prevent  decay  of  recall  by  providing  periodic  refresher  training. 

r 

6.  Use  mental  rehearsal  of  sequential  steps,  if  readily  codable  in  symbolic 
form  (mediators)  . 

7.  Maximize  control  of  cues  to  ensure  that  the  trainee  if  forming  the  proper 
associations,  i.e.,  responding  appropriately  to  the  correct  cues. 

8.  In  training  for  recall  of  lengthy  or  difficult  procedures,  develop 
redundant  cue  response  patters  (via  primary  and  supplementary  stimuli)  to 
trigger  the  sequentially  next  correct  response. 

9.  Use  programmed  demonstration  of  procedures,  up  to  but  not  beyond  ability 
of  student  to  understand  procedures. 

10.  Stimuli  used  in  training  should  be  nearly  identical  to  job  stimuli  unless 
this  fidelity  increases  problem  difficulty  in  the  initial  phase  of 
training  to  an  unacceptable  level. 

11.  Vary  ratio  of  relevant  and  irrelevant  (transient)  stimuli  according  to 
requirements  of  various  stages  of  training.  Maximize  relevant  cues  and 
minimize  irrelevant  cues  in  early  stages  of  training;  use  a  realistic 
mix  of  relevant  and  irrelevant  cues  in  final  stages  of  training. 

12.  Emphasize  cues  which  elicit  mediating  responses,  e.g.,  "self-instructions 
"population  stereotypes"  and  "natural  associations." 

13.  Transfer  increases  as  the  difference  between  reference  and  generalization 
stimulus  decreases. 

14.  Decrease  signal-to-noise  ratio  as  student  achieves  success  at  a  given 
difficulty  level. 


APPENDIX  A  (Cont'd.) 


15.  Emphasize  the  logical  relationships  which  exist  between  the  general 
principle  and  the  specific  application.  The  unique  or  special 
features  of  each  application  should  be  minimized  while  the  comon 
relationships  to  the  general  principle  should  be  emphasized. 

16.  Stimulus  redundancy  -  apply  principle  in  a  large  number  of  practice- 
situations,  while  varying  the  stimulus  context  of  repetitions. 

17.  Trainees  must  have  access  to  potentially  relevant  data.  In  final 
stage  of  training,  data  should  be  limited  to  that  expected  in  real 
world  situation. 

18.  Guiding  -  early  in  training  present  logical  implications  of  alterna¬ 
tive  choices. 

19.  Mediators  -  acquisition  and  use  of  mediators  such  as  stereotypes  or 
self-instructions  facilitate  the  identification  of  response  alternatives 
and  the  probability  of  success  of  each  alternative. 

I 

20.  Stimulus  load  -  toward  the  end  of  training,  present  trainee  with  a 
realistic  data  processing  load  (realistic  number  of  significant  signals 
plus  realistic  noise  in  real  time.) 

21.  Stimulus  generalization  -  vary  the  stimulus  context  of  repetitions. 

22.  Insure  that  the  appropriate  stimulus  cues  are  available  to  the  trainee 
continually  during  the  performance  of  the  task. 

23.  Emphasis  on  prediction  of  future  states  (thinking  ahead). 

24.  Expose  trainee  to  a  wide  range  of  task  difficulty. 

25.  In  continuous  control  casks,  high  fidelity  is  often  required  in 

(1)  stimulus  presentation,  (2)  operator  response  characteristics,  and 
(3)  dynamic  system  behavior,  the  evolving  display-control  relationship. 

26.  Contiguity  -.the  symbol  and  referent  should/-be  presented  in  close  temporal 
contiguity. 

27.  Cue  development  -  emphasize  the  development  and  use  of  internal  cues, 
such  as  mediators  or  kinesthetic  cues. 

28.  In  training  for  lengthy  serial  movements,  provision  should  be  made  for 
programming  demonstrations  of  the  lengthy  serial  or  sequential  performance 
according  to  the  amount  of  demonstration  which  can  be  understood  by  the 
trainee.  Continuing  a  demonstration  beyond  the  "saturation  point"  will 
result  in  the  association  of  responses  with  incorrect  cues. 
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29.  Early  training  -  use  models'  of  correct  perf orrr.ance  as  a  basis  for 
trainee  to  perceive  critical  cues  of  good  form.  Use  models  of  com¬ 
ponent  parts  of  task. 

30.  Cue  discrimination  -  perceive  inference  between  correct  and 
incorrect  form. 

31.  Later  stages  of  training  -  the  kinesthetic  cues  dominate  (cues  based 
on  "muscle  feel") . 

32.  Performance  aids  -  especially  in  early  phase  of  training  use  a  performance 
aid  or  model,  such  as  instructions,  checklists  or  standard  exanpics/i orr.ats 
to  aid  in  perceiving  need  for  and  composing  of  messages. 

33.  "in-the-head"  mediators  -  in  later  stages  of  instruction  rely  on  "in-the- 
head"  instructions,  models,  etc.,  to  aid  in  perceiving  need  for  and 
composing  required  messages. 

34.  Static  and  dynamic  models  -  in  early  phase  of  training  use  models,  such 
as  still  and  moving  graphic  displays  (video  tape  recordings)  to  establish 
the  characteristics  of  criterion  performance. 

35.  Pre-training  methods  need  to  take  care  not  to  make  the  S  dependent  upon 
the  extra  cues  provided  in  the  early  stages  of  training  and  thus  to 
hinder  the  changeover  to  more  direct  relations  between  input  and  output 
at  a  later  stage. 

36.  With  very  complex  tasks,  instruction  in  principles  yields  better  results 
than  laying  down  a  detailed  drill,  while  with  simpler  tasks  the  drill  is 
at  least  equally  effective. 
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APPENDIX 


Response  Considerations 

1.  Make  an  overt  response  indicating  the  recall  of  facts  and  principles, 
enabling  measures.  (Add  appropriate  phrase  for  each  behavioral 
category.) 

2.  Response  Generalization  -  make  job  performance  type  responses  (i.e., 
high  fidelity  responses  later  in  training). 

3.  Guide  or  prompt  response,  especially  in  the  acquisition  phase  of 
training. 

4.  To-be-learned  response  should  occur  as  soon  as  relevant  cues  are 
perceived  (contiguous  occurrences  of  cues  and  response). 

5.  The  strength  of  a  given  response  typically  increases  as  a  function  of 
practice. 

6.  To  enable  reinforcement  of  performance,  the  student,  upon  detecting  a 
signal,  should  respond  so  that  what  is  detected  and  time  of  detection 
can  be  recorded. 

7.  Performance  differences  which  are  due  to  individual  differences  in 
ability  tend  to  be  magnified  as  a  function  of  increasing  task  difficulty 
Identical  performance  among  given  trainees  is  not  necessarily  indicative 
of  identical  learning,  hence  the  need  for  a  better  measure  of  the  extent 
to  which  trainees  are  profiting  from  the  training  situation. 

8.  Apply  decision  making  in  a  large  number  of  practice  situations  while 
varying  the  stimulus  context  of  repetitions. 

9.  Stress  -  when  trainee  will  be  required  to  perform  under  stress,  use 
overlearning  of  skill  to  minimize  effects  of  competing  responses. 

10.  Repetition:  highly  skilled  performance  requires  extensive  practice. 

11.  Make  an  objective  measurement  of  the  frequency  and  type  of  errors  - 
changes  in  total  error  pattern  -  throughout  the  course  of  training. 
Measurement  should  be  based  on  specific  behavioral  .objectives. 

12.  Symbol  -  referent  associations  (pairings)  are  especially  amenable  to 
"in-the-head"  practice. 

13.  Emphasize  extensive  motor  response  repetition  or  practice  in  order 

to  (1)  strengthen  individual  or  component  steps  of  the  movement  series, 
and  (2)  integrate  these  steps  into  a  smooth  sequence. 

14.  Emphasize  overt  respondings  in  a  social  context.  Practice  to  strengthen 
correct  responses. 
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Record  responses  in  context.  Since  the  response  is  typically  complex 
involving  subtle  relations  among  components,  the  technique  of  mea¬ 
surement  should  provide  for  recording  the  total  complex  in  a  manner 
that  permits  analysis  of  such  subtle  relationships. 


When  skill  is  not  regularly  used,  prevent  decay  of  recall  by  providing 
periodic  refresher  training. 


The  usefulness  (for  "lateral"  transfer)  of  any  learned  capability  will 
be  increased  if  it  is  practiced  in  as  wide  a  variety  of  situations  as 
possible. 


Ensure  that  relevant  subordinate  capabilities  have  been  thoroughly 
learned  before  calling  on  vertical  (e.g.,  inclusion)  transfer  to  aid 
the  learning  of  "advanced"  capabilities. 


Vertical  transfer  is  enhanced  by  the  variety  of  previous  knowledge. 


Where  the  whole  task  is  a  closely  coordinated  activity  such  a^S  aiming 
a  rifle  or  stimulated  flying  of  an  aircraft,  it  is  better  to  tackle 
the  task  as  a  whole.  Any  attempt  to  divide  it  up  tends  to  destroy 
the  proper  coordination  of  action  and  subordination  of  individual  actions 
to  the  requirements  of  the  whole,  and  thus  outweighs  any  advantage  there 
might  be  in  mastering  different  portions  of  the  task  separately. 


Where  the  task  involves  a  series  of  component  actions  which  have  to  be 
performed  in  the  correct  order  but  each  is  largely  independent  of  the 
others,  there  seem  to  be  advantages  in  practicing  the  different  components 
separately. 


Continuous  practice  facilitates  mastery  of  complex,  meaningful  material 
and  the  establishment  of  coordinated  rhythmic  activity  (within  limits  of 
fatigue) . 


Continuous  practice  seems  to  be  preferred  by  older  trainees. 


Spaced  practice  is  more  efficient  than  continuous  if  only  the  actual 
duration  of  the  sessions  is  counted  and  the  time  between  sessions  is 
ignored.  When  the  time  between  sessions  is  included,  continuous  practice 
is  usually  more  efficient. 


25.  Very  brief  pauses  between  practice  sessions  should  be  as  effective  as 
longer  ones. 


26.  "Mental  practice"  in  which  the  £  performs  a  task  in  the  imagination,  can 
often  be  substituted  for  a  substantial  amount  of  practice  involving  full 
performance  with  little  if  any  loss  of  effectiveness. 
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27.  Relatively  little  learning  occurs  if  Ss  are  passive  spectators  or  even 
passive  performers,  but  that  they  must  be  involved  in  active  decisions 
and  choices  about  what  they  are  doing,  and  it  is  these  that  they  will 
retain  whether  they  are  right  or  wrong. 

28.  If  two  or  more  tasks  have  to  be  learned,  it  is  most  beneficial  to  begin 
with  the  one  which  elicits  the  greatest  care  and  effort  towards  the 
attainment  of  a  high  standard  of  performance.  However,  if  £>  was  not 
allowed  to  continue  to  practice  the  more  difficult  task  until  a  point 

of  reasonable  mastery,  he  would  be  left  with  an  inadequate  comprehension 
of  the  task,  and  transfer  to  a  simpler  task  might  be  confused  and  less 
satisfactory  than  if  he  had  tackled  the  easier  task  first. 

29.  The  more  sub-tasks  there  are  in  the  overall  task,  and  the  more  they 
interact  with  one  another,  the  more  opportunity  there  will  be  for  improve¬ 
ment,  and  therefore  the  longer  improvement  will  continue. 

30.  Transfer  of  skill  from  one  task  to  another  will  depend  not  so  much  upon 
the  extent  to  which  methods  possible  for  one  are  applied  to  tfie  other, 
but  the  extent  to  which  methods  which  have  been  selected  for  the  one  are 
applied  to  the  other. 

31.  Effectiveness  of  spacing  practice  depends  on  what  is  done  during  the 
times  between  practice  periods:  (a)  If  they  are  spent  in  rehearsal  of 
the  material,  learning  will  benefit,  unless  the  task  is  fatiquing  in 

.  which  case  continued  practice  may  depress  subsequent  performance,  (b) 

If  time  between  practice  periods  are  spent  on  another  task,  learning 
or  later  recall  of  the  first  task  may  be  impaired,  the  degree  of 
impairment  depending  on  the  degree  of  similarity  between  the  two  tasks. 


APPENDIX  A  (Cont'd.) 


Feedback  Considerations 


1.  Schedule  KOR  (knowledge  of  results)  soon  after  response  for  ir.aKir.us 
reinforcement.  Error  identification  function  of  KOR  is  significant. 

2.  Especially  early  in  training,  use  KOR  after  the  response  to  each  step, 
for  maximum  reinforcement.  Error  identification  function  of  KOR  is 
significant.  In  later  stages  of  training,  step  feedback  is  not  so 
critical. 

3.  As  training  progresses,  gradually  increase  the  delay  in  presenting 
KOR  (present  KOR  in  increments  of  2  steps,  then  3  steps,  etc.)  until 
the  schedles  of  KOR  approximates  the  operational  setting. 

A.  Immediate  reinforcement  (0.5  second  delay)  for  non-verbal  identification 

5.  KOR  -  automatic  system  performance  feedback  (e.g.,  if  target  is  identi¬ 

fied  from  partial  cues,  present  the  target  with  a  full  set  of  cues 
after  identification;  automate  if  possible).  t 

6.  Feedback  omission  schedule  programmed  according  to  stage  of  training: 
high  feedback  during  initial  stages,  decreased  to  equivalent  to 
operational  setting  or  lower. 

7.  Schedule  KOR  soon  after  response  for  maximum  reinforcement.  KOR  should 
deal  with  both  process  and  solution. 

8.  Early  in  training,  evaluate  each  alternative  solution  as  it  is  identi¬ 
fied,  and  when  a  final  choice  among  alternatives  is  made,  evaluate  the 
overall  choice. 

9.  Shaping  -  reinforcement  should  be  contingent  upon  characteristics  of 
trainee's  response  so  that  by  a  process  of  'successive  approximations,' 
the  final  desired  proficiency  is  produced. 

10.  Continuous  KOR  -  because  of  the  dynamic  nature  of  the  problem,  the 
trainer  should  at  times  be  presented  with  an  on-going  evaluation  of  his 
performance. 

11.  Incorrect  as  well  as  correct  symbol-referent  pairing  can  be  strengthened 
by  self-initiated  "in-the-head"  practice. 

12.  Extensive  response  repetition  (overlearning)  by  the  trainee  to  take 
advantage  of  the  built-in  feedback  properties  of  these  types  of  tasks. 
Simple  repetitive  movements  may  be  ''automatically"  reinforcing 
(Kinesthetic  feedback.) 
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Provide  record  of  trainee’s  overt  response  to  enable  evaluation  of 
trainee  performance  (i.e.,  must  know  what  Ss  are  doing  in  order  to 
provide  KOR) . 

Analyze  oral  verbalization  recordings  to  evaluate  trainer /team 
performance  and  provide  KOR. 

Performance  improvement  in  acquisition  depends  on  knowledge  of 
results  (KOR).  The  rate  of  improvement  depends  upon  the  precision 
of  KOR  (within  limits  of  meaningfulness). 

Delay  of  KOR  has  little  or  no  effect  on  acquisition  (for  simple 
motor  movements  only) . 

Increasing  the  post-KOR  interval  up  to  a  point  will  improve  perform¬ 
ance  level  in  acquisition  (spacing  during  practice).  The  "point"  is 
when  recall  of  movement  or  KOR  is  affected. 

The  type  of  activity  in  the  KOR  delay  or  post-KOR  delay  internal  does 
not  influence  acquisition  (provided  the  intervening  activity  is  not 
of  the  same  type) . 

Withdrawal  of  KOR  produces  deterioration  of  performance  when  level  of 
training  is  low  or  moderate. 

When  KOR  is  delayed  in  acquisition,  and  engages  in  deliberate  verbal 
or  motor  activity  during  the  delay  interval,  the  effect  of  KOR  with¬ 
drawal  is  poorer  performance  than  when  £  rests. 

When  KOR  is  delayed  in  acquisition,  and  rests  during  the  delay 
interval,  the  effect  on  performance  when  KOR  is  withdrawn  is  no  dif¬ 
ferent  than  when  immediate  KOR  is  used. 

Activity  in  the  post-KOR  delay  interval  during  acquisition  worsens 
performance  when  KOR  is  withdrawn. 

After  a  relatively  large  amount  of  trainings  learning  can  continue  when 
KOR  is  withdrawn. 

If  errors  could  be  prevented  in  the  first  few  trials  (e.g.,  guidance) 
mastery  of  the  task  should  be  very  much  quicker. 

Guidance  during  training  is  beneficial  when  tracking  movements  have  to 
be  made  with  an  incompatible  control-display  relationship. 

Guidance  does  not  aid  simple  repetitive  movements,  but  aids  learning 
complex  courses. 
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APPENDIX  A  (Cor.t’d.) 

27.  The  manner  of  conveying  KOFt  is  important:  (a)  Effectiveness  is 
greatest  when  the  information  is  clearly  and  simply  related  to  the 
action  performed.  Any  distortion  or  equivocation  in  the  information 
fed  back  to  the  will  reduce  its  effectiveness.  (b)  Unduly  full 

or  complex  information  may  be  partly  ignored  or  may  confuse  the  S. 

(c)  The  information  given  should  indicate  the  discrepancy  between 
what  is  required  and  what  has  been  achieved  rather  than  merely  givc- 
a  reminder  of  requirements  or  some  broad  measure  of  achievement. 

28.  Performance  is  best  maintained  when  the  conditions  are  such  as  to 
emphasize  the  need  for  £  to  observe  the  feel  of  his  actions  in  order 
to  relate  then  to  their  results. 

29.  A  must  have  some  cues  to  the  results  of  his  actions  if  he  is  to 
perform  accurately  at  all,  and  training  procedures  will  be  effective 
in  so  far  as  they  help  him  to  observe  and  use  such  cues  as  are 
inherent  in  the  task  for  which  he  is  being  trained.  They  will  fail 
in  so  far  as  they  provide  him  with  extra  cues  on  which  he  comes  to 
rely  but  which  are  not  available  when  he  changes  from  training  to  the 
actual  job. 

30.  KOR  acts  as  an  incentive. 
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iask  Connonalitv  Analysis 


The  purpose  of  the  task  coramd nalicy  analysis  is  to  describe  cne  overlap 
in  training  content  between  the  operational  situation  and  the  training  device. 
Commonality  is  said  to  exist  when  a. subtask  can  be  performed  and  practiced 
in  the  training  situation  (with  the  device)  and  in  the  operational  situation. 

Rate  each  subtask  on  the  following  two-point  scale: 


Definition 

Training  device  permits  practice  of  the  subtask. 

Training  device  does  not  permit  practice  of  the  subtask. 


TASK  COMMONALITY  ANALYSIS 


Name  of  Task:  HIT  MOVING  TARGET 


Physical  Similarity  Analysis 


The  physical  similarity  analysis  deals  with  the  similarity  bet-ecr. 
physical  characteristics  of  the  training  device  and  those  of  the  operational 
situation.  The  assessment  is  based  on  the  physical  similarity  (such  as 
location,  appearance,  and  feel).  Ignore,  for  now,  the  amount  and  quality 
of  information. 

Rate  relevant  control  and  display  to  describe  how  well  the  control  or 
display  is  represented  in  .the  training  device.  Base  your  physical  similarity 
ratings  on  the  following  four-point  scale: 


PHYSICAL  SIMILARITY  RATING  SCALE 


Rating 


Definition 


2 


1 


0 


Identical.  The  trainee  would  not  notice  a  difference  between 
the  training  device  control  or  display  and  the  operational 
control  or  display  at  the  time  of  transfer.  Note) that  they 
need  not  be  absolutely  identical,  but  there  must  be  no  notice¬ 
able  difference  for  the  trainee. 

Similar.  The  trainee  would  notice  a  difference  at  the  time 
of  transfer,  but  he  would  be  able  to  perform  the  task.  There 
might  be  a  decrement  in  performance  at  transfer,  but  any  such 
decrement  would  be  readily  overcome.  *—* 

Dissimilar.  There  would  be  a  large  noticeable  difference, 
quite  apparent  to  the  trainee  at  transfer,  and  a  large  per¬ 
formance  decrement,  given  that  the  trainee  could  perform  at 
all.  Specific  instruction  and  practice  would  be  required 
on  the  operational  equipment  after  transfer  to  overcome  the 
decrement. 

The  control  or  display  is  not  represented  at  all  in  the  train¬ 
ing  device. 


Name  of  Task:  HIT  MOVING  TARGET 


REQUIRED  TASK 
CONTROLS  AND  DISPLAYS 


Ci  Ammunition  selector  handle 


C2  Main  gun  switch 


C3  Microphone 


C^  Gunner's  control  handles 


C5  Magnetic  brake  palm  switches 


Cg  Firing  triggers 


Di  Earphones 


D2  Ammunition  display  window 


D3  Main  gun  switch  light 


D4  M-32  sight  (eyepiece,  headrest, 
8X  magnification) 


D5  Moving  target 


Dg  Reticle 


Sum  of  Physical  Similarity 
Ratings 


Physical  Similarity  Index 


Physical  _ Su 

Similarity  ■  3 

Index 


Sura  of  Similarity  Ratings  for  Device 
3  (if  of  Rq'd  Controls  &  Displays) 


Die  functional  similarity  analysis  compares  the  operator's  behavior  in 
terms  of  the  information  flow  from  each  display  to  the  operator,  and  from 
the  operator  to  each  control.  The  assessment  is  made  in  terms  of  the  amount 
of  information  transmitted  from  each  display  to  each  control  and  the  type  of 
information-processing  activity  performed  by  the  operator.  The  issue  is  not 
the  physical  fidelity  of  a  control  or  display  but  whether  the  operator  acts 
on  the  same  amount  of  information  in  the  same  way  in  both  the  operational  and 
the  training  situation. 

For  each  control  and  display  estimate  the  number  of  states  (or  discrete 
values)  which  the  display  or  control  may  assume  in  the  training  device. 

Then  compare  the  number  of  states  in  the  training  situation  with  the  device 
to  the  corresponding  number  in  the  operational  situation. 

For  each  required  task  control  or  display,  rate  how  well  it  is  functionall 
represented  in  each  training  device.  Base  your  functional  similarity  ratings 
on  the  following  four-point  scale: 


FUNCTIONAL  SIMILARITY  RATING  SCALE 


Rating  Definition 

3  Identical.  The  number  of  states  in  the  training  situation 

is  the  same  as  the  number  of  states  in  the  operational  “ — 
setting. 

2  Similar.  The  number  of  states  in  the  training  situation  is 

at  least  half  of  the  number  of  states  in  the  operational 
setting. 

1  Dissimilar .  The  number  of  states  in  the  training  situation 

is  less  than  half  of  the  number  of  states  in  the  operational 
setting. 

0  Missing .  The  control  or  display  is-  not  represented  at  all 

in  the  training  device. 


t :;::la*:ity  analysis 


Na^e  of  Task:  HIT  MOVING  TARGET 
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Skills  and  Knovlc-dces  RequircDents 


The  skills  and  knowledges  requirements  analysis  assesses  the  skills 
and  knowledges  in  the  student's  repertory  before  training  and  compares 
them  to  the  skills  and  knowledges  required  for  successful  performance  of 
the  task. 

For  each  skill  and  knowledge,  estimate  how  much  of  the  skill  or 
knowledge  the  average  trainee  could  be  expected  to  have  on  first  exposure 
to  the  training  device.  Assume  that  the  average  trainee  is  a  high  school 
graduate  in  Armor  OSUT  who  has  completed  common  soldier  and  tank  driver 
blocks  of  instruction.  Base  your  ratings  on  the  following  scale: 


RATING  SCALE  FOR  SKILLS  AND  KNOWLEDGES  BEFORE  TRAINING 


RatinR  Definition 

4  Has  a  complete  understanding  of  the  skill  or  knowledge).  Can 

do  the  steps  in  this  subtask  that  require  the  skill  or  know¬ 
ledge  completely  and  accurately  without  supervision. 

3  Understands  this  skill  or  knowledge  but  may  require  super¬ 

vision  to  do  the  steps  in  this  subtask  that  require  the  skill 
or  knowledge.  Level  of  proficiency  equals  what  would  be 
expected  after  several  practice  trials  of  the  step.  ‘r“* 

2  Is  familiar  with  this  skill  or  knowledge,  but  would  require 

assistance  on  the  steps  in  this  subtask  that  require  the  skill 
or  knowledge.  Level  of  proficiency  equals  what  would  be 
expected  from  a  complete  briefing  and  one  performance  of  the 
task  step. 

1  Has  a  limited  experience  or  familiarity  with  this  skill  or 

knowledge.  Level  of  proficiency  equals  what  would  be  expected 
from  an  orientation. 

0  No  experience  or  familiarity  with  this  skill  or  knowledge. 

Cannot  perform  a  task  step  requiring  this  skill  or  knowledge. 


Next,  rate  the  amount  of  each  skill  knowle-ct.e  the  trainee  must  have 

to  do  the  task  (hit  moving  targets  as  a  gunner)  in  the  operational  situation. 
Base  your  racings  on  the  following  scale: 


RATING  SCALE  FOR  SKILLS  AND  KNOWLEDGES  AFTER  TRAINING 


Rating  Definition 

4  Should  be  able  to  apply  skill  or  knowledge  under  all  condi¬ 

tions  without  hesitation.  System  will  not  tolerate  errors. 

3  Should  be  able  to  apply  skill  or  knowledge  under  most  condi¬ 

tions  without  hesitation.  System  will  not  tolerate  infrequent 
errors. 

2  Should  have  skill  or  knowledge  equivalent  to  briefing  and 

some  practice  but  does  not  need  to  be  able  to  apply  knowledge 
or  skill  without  error.  System  will  tolerate  occasional 
errors. 

1  Should  have  skill  or  knowledge  equivalent  to  briefing  on 

knowledge  or  on  performance  of  skill.  System  will  tolerate 
frequent  errors. 


Leave  the  column  for  Difference  (After-Before)  blank 


SKILL  AND  KNOWLEDGE  REQUIREMENTS  ANALYSIS 


Name  of  Task:  HIT  MOVING  TARGET 


REQUIRED  TASK 
SKILL  AND  KNOWLEDGE 


Si  Is  able  to  distinguish  between 
targets  and  friendlies 


S2  Is  able  to  estimate  speed  of  target 


S3  Is  able  to  maintain  smooth  track 


S4  Is  able  to  sense  rounds 


Ki  Knows  procedure  to  index  ammunition 
(including  when  to  index  ammunition) 


K2  Knows  that  saying  IDENTIFIED  is 
response  to  TC  saying  GUNNER,  (AMMO 
TYPE),  (TARGET  TYPE)  and  Gunner  seeing 
the  target 


K3  Knows  number  of  lead  lines  for 
ammunition  types. 


K4  Knows  number  of  lead  lines  for 
speed  of  target 


K5  Knows  crosshair  leadline  is  placed  on 
target's  center  of  mass  (with  lead 
applied) 


Kg  Knows  that  saying  ON  THE  WAY  is 

response  to  crosshair  leadline  being 
on  target's  center  of  mass,  TC  saying 
FIRE,  and  Loader  saying  UP 


Kj  Knows  that  sensing  la  mental  notation 
of  the  point  in  the  sight  reticle  where 
burst  of  round  appears  as  it  passes, 
strikes  short  of,  or  hits  the  target. 


K8  Knows  there  are  three  deflection  sensings 
(LEFT,  RIGHT,  LINE)  and  four  range 
sensings  (SHORT,  OVER,  DOUBTFUL,  TARGET) 


K9  Knows  that  saying  BOT  is  response  to 
sensing  round 


KlO  Knows  to  move  point  of  sight  reticle 
by  most  direct  route  from  where  burst 
of  round  appears  to  target's  center 
of  mass 


Kn  Knows  that  saying  ON  THE  WAY  is  response 
to  point  of  sight  reticle  where  burst  of 
round  appears  being  on  target's  center 
of  mass  and  Loader  saying  UP 


BEFORE 

DIFFERENCE 

TRAINING 

(AFTER- BEFORE) 

Skill  &  Knowledge  Requirements  Index 


_ Total  Difference  Score _ 

A (Number  of  Skills  and  Knowledges) 


Task  Training  Difficulty 


The  task  training  difficulty  analysis  estimates  the  difficulty  (in  terns 
of  training  time)  of  training  soldiers  to  perform  the  required  tasks  successful!. 
Assign  ratings  based  on  the  assumption  that  training  occurs  on  the  operational 
equipment.  In  this  case,  operational  equipment  is  a  tank,  dry  fire,  with 
moving  targets  (8x8  panels). 

For  each  required  task  element,  rate  the  amount  of  training  time  for  sur¬ 
mounting  its  associated  deficit  relative  to  the  most  time-consuming  task  element. 
Base  your  task  training  difficulty  ratings  on  the  following  five-point  scale: 

TASK  TRAINING  DIFFICULTY  RATING  SCALE 


Rating 

Definition 

4 

Requires  as  much  time  to  train  as  the  most  time-consuming 
task  element. 

3 

Requires  substantial  training  time,  but  less  than  above. 

2 

Requires  a  moderate  amount  of  training  time  relative  to  the 
most  time-consuming  task  element. 

1 

Requires  only  minimal  training  time  relative  to  the  most 
time-consuming  task  element.  ■* — 

0 

Requires  no  training  time. 

I 


APPENDIX  C 


TV IV  WORKBOOK 


* 


cv  .tragi:  R-a::Ri:.'z:;T  a::?  go. 

Coverage  Requirement  Anal vs  if 


The  purpose  of  the  Coverage  Requirement  (CR)  Analysis  is  to  determine  which 
skills  and  knowledges  must  be  covered  by  a  training  device.  The  skills  and 
knowledges  for  the  task  are  listed  on  the  worksheet.  Assume  that  the  device 
is  to  be  used  in  OSUT  training.  Trainees  will  have  completed  driving  seg¬ 
ments  but  will  not  have  had  any  gunnery  training.  Rate  each  skill  and 
knowledge  on  the  following  scale: 


Rating  Definition 

1  Required  in  training. 

0  Not  required  in  training. 


Coverage  Analysis 

i 

The  purpose  of  the  Coverage  (C)  Analysis  is  to  determine  whether  a  device 
provides  training  for  each  skill  and  knowledge.  Rate  each  skill  and  knowledge 
for  each  device  on  the  following  scale: 


Rating  Definition 

•  1  Provides  training  coverage  for  the  ski 11 /knowledge. 

0  Does  not  provide  training  coverage  for  the  skill/knowledge. 


Rate  all  skills  and  knowledges  for  a  device  before  you  rate  any  skill  or 
knowledge  for  another  device. 
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COVERAGE  REQUIREMENT  (CR)  AND  COVERAGE  (C)  WORKSHEET 


SKILLS  AND  KNOWLEDGES 


Si  Is  able  to  distinguish  between  targets  and 
friendlies 


S2  Is  able  to  estimate  speed  of  target 


S3  Is  able  to  maintain  smooth  track 


S4  Is  able  to  sense  rounds 


Kl  Knows  procedure  to  index  ammunition  (including 
when  to  index  anmunltlon) 


K2  Knows  that  saying  IDENTIFIED  is  response  to  TC 
saying  GUNNER,  (AMMO  TYPE),  (TARGET  TYPE)  and 
Gunner  seeing  the  target 


K3  Knows  number  of  lead  lines  for  ammunition  types 


K4  Knows  number  of  lead  lines  for  speed  of  target 


K5  Knows  crosshair  leadline  is  placed  on  target's 
center  of  mass  (with  lead  applied) 


Kg  Knows  that  saying  ON  THE  WAY  is  response  to 
crosshair  leadline  being  on  target's  center  of 
mass,  TC  saying  FIRE,  and  Loader  saying  UP 


K7  Knows  that  sensing  is  mental  notation  of  the 
point  in  the  sight  reticle  where  burst  of 
round  appears  as  it  passes,  strikes  short  of, 
or  hits  the  target 


Kg  Knows  there  are  three  deflection  sensings 
(LEFT,  RIGHT,  LINE)  and  four  range  sensings 
(SHORT,  OVER,  DOUBTFUL,  TARGET) 


K9  Knows  that  saying  BOT  is  response  to  sensing 
round 


K^^Knows  to  move  point  of  sight  reticle  by  most 
direct  route  from  where  burst  of  round  appears 
to  target '8  center  of  mass 


KnKnowa  that  saying  ON  THE  WAY  is  response  to 
point  of  sight  reticle  where  burst  of  round 
appears  being  on  target's  center  of  mass  and 
Loader  saying  UP 


E3unEEBB3a^^E^MI 


tv 


tr.\ proficiency  and  leading  difficulty 


Training  Proficiency  Analysis 


The  purpose  of  Che  Training  Proficiency  (P)  Analysis  is  to  determine 
the  degree  of  proficiency  Che  trainee  must  aCtain  ac  the  end  of  training. 
First,  cross  out  any  skills  or  knowledges  that  you  decided  did  not  need  to 
be  trained  (CR«*0) .  Rate  each  remaining  skill  and  knowledge  on  the  following 
scale: 


Rating  Definition 

A  Should  be  able  to  apply  skill  or  knowledge  under  all  conditions 

without  hesitation.  System  will  not  tolerate  errors. 

3  Should  be  able  to  apply  skill  or  knowledge  under  most  conditions 

without  hesitation.  System  will  not  tolerate  infrequent  errors. 

2  Should  have  skill  or  knowledge  equivalent  to  briefing  and  some 

practice  but  does  not  need  to  be  able  to  apply  knowledge  or 
skill  without  error.  System  will  tolerate  occasional  errors. 

1  Should  have  skill  or  knowledge  equivalent  to  briefing  on 

knowledge  or  on  performance  of  skill.  System  will  tolerate 
frequent  errors. 


Learning  Difficulty  Analysis 


The  purpose  of  the  Learning  Difficulty  (D)  Analysis  is  to  determine 
the  degree  of  difficulty  associated  with  learning  each  required  (CR*1)  skill 
and  knowledge.  Assume  that  the  trainee  is  a  high  school  graduate  in  Armor 
OSUT.  He  has  completed  driving  training  but  has  no  experience  with  gunnery. 
The  training  program  will  consist  of  classroom  instruction  and  dry-fire  with 
an  M60A1  tank  and  moving  8x8  panels.  Rate  the  difficulty  of  training  each 
skill  or  knowledge  in  such  a  program  using  the  following  scale: 


Definition 


Easy.  Trainee  can  accomplish  the  activity  once  informed  that 
it  exists;  no  practice  or  study  is  required. 

Modestly  Difficult.  Trainee  can  accomplish  most  of  the 
activity  after  classroom  instruction;  some  of  the  activity 
requires  minimal  skill  practice  or  study  for  acquiring  the 
needed  level  of  proficiency. 

I ' 

Difficult .  Trainee  can  accomplish  the  activity  only  if  class¬ 
room  instruction  is  accompanied  by  practice  or  study. 


Rating 


2 


3 


4 


Highly  Difficult.  Trainee  can  accomplish  the  activity  only 
if  classroom  instruction  is  accompanied  by  extensive  practice 
or  study. 


.  l  t  «'»  41*  a|*  At*  Jl1*.  »»*  «?.  ■!*  *> .  At .  ■*>_  «W1L  *«f  -  A»a.  W»  ntyl  m  p*g. 


TRAIN INC  PROFICIENCY  (P)  AND  LEAK.** I ! 
DIFFICULTY  (D)  WORKSHEEI 


SKILLS  AND  KNOWLEDGES 


Si  Is  able  to  distinguish  between  targets  and  friendlies 


S2  Is  able  to  estimate  speed  of  target 


S3  Is  able  to  maintain  smooth  track 


S4  Is  able  to  sense  rounds 


K3  Knows  procedure  to  index  ammunition  (including  when 
to  index  ammunition) 


K2  Knows  that  saying  IDENTIFIED  is  response  to  TC  saying 
GUNNER,  (AMMO  TYPE),  (TARGET  TYPE)  and  Gunner  seeing 
the  target  . 


K3  Knows  number  of  lead  lines  for  ammunition  types 


K4  Knows  number  of  lead  lines  for  speed  of  target 


K5  Knows  crosshair  leadline  is  placed  on  target’s  center 
of  mass  (with  lead  applied). 


Kg  Knows  that  saying  ON  THE  WAY  is  response  to  crosshair 
leadline  being  on  target's  center  of  mass,  TC  saying 
FIRE,  and  Loader  saying  UP  _  _ 


K7  Knows  that  sensing  is  mental  notation  of  the  point  in 
the.  sight  reticle  where  burst  of  round  appears  as  it 
passes,  strikes  short  of,  or  hits  the  target. 


Kg  Knows  there  are  three  deflection  sensings  (LEFT,  RIGHT, 
LINE)  and  four  range  sensings  (SHORT,  OVER,  DOUBTFUL, 
TARGET)  ‘ 


K9  Knows  that  saying  BOT  is  response  to  sensing  round 


KiQKnous  to  move  point  of •  sight  reticle  by  most  direct 
route  from  where  burst  of  round  appears  to  target's 
center  of  mass  _ 


KnKnows  that  saying  ON  THE  WAY  is  response  to  point  of 
sight  reticle  where  burst  of  round  appears  being  on 
target's  center  of  mass  and  Loader  saying  UP 


■  ■*  ■%-  “  M. 


i  ■ 


‘•Hi  SI  CAL  CHARACTERISTICS  AND  FUNCTIONAL  CHARACTERISTICS 


The  purpose  of  tne  Physical  Characteristics  Analysis  is  to  assess  now 
well  the  physical  characteristics  of  a  device  support  good  instructional 
practice.  Tou  must  complete  a  worksheet  for  each  relevant  skill  and  knowledge 
(CRml)  if  any  device  being  considered  covers  the  skill  or  knowledge  (C~l) . 

The  worksheet  includes  ratings  for  each  device. 

First  decide  which  one  of  the  following  categories  best  describes  learning 
for  the  skill  or  knowledge: 


BEHAVIORAL  CATEGORIES 

(1) 

Rule  Learning  and  Using 

(2) 

Classifying  -  Recognizing  Patterns 

(3) 

Identifying  Symbols  i 

(A) 

Detecting 

(5) 

Making  Decisions 

(6) 

Recalling  Bodies  of  Knowledge 

(7) 

Performing  Gross  Motor  Skills 

(8) 

Steering  and  Guiding  -  Continuous  Movement 

(9) 

Positioning  Movement  and  Recalling  Procedures 

(10) 

Voice  Communications 

The  categories  are  defined  and  illustrated  in  Appendix  A.  List  the  category 
in  column  I. 

Next  determine  which  learning  guidelines  in  Appendix  B  apply  to  the 
physical  characteristics  for  the  generic  type  of  device  for  training  the 
behavior.  The  guidelines  are  grouped  by  behavioral  categories.  The  guide¬ 
lines  that  might  apply  to  physical  characteristics  are  labelled  P  or  P/F. 
Some  of  the  guidelines  may  not  apply  to  a  training  device  for  an  entry  level 
gunner.  List  the  guidelines  that  do  apply  in  column  II  of  the  worksheet. 
Include  the  number  and  an  abbreviated  statement  of  each  relevant  guideline. 
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re  r  i.^;  dev:  -.  ,  list,  the  displays  and  controls  that  contribute  to 
training  ti v  shill  ?r  knowledge.  If  the  device  does  not  cover  the  skill 
or  knowledge  (C=G j  ,  enter  NOME.  Put  these  entries  in  column  Ill  of  the 
worksheet.  * 

The  next  step  is  to  determine  which  characteristics  of  the  relevant 
displays  and  controls  contribute  to  training  the  skill  or  knowledge.  Review 
the  generic  stimulus  characteristics  that  are  listed  in  column  IV  of  the 
worksheet  (and  defined  in  Table  1)  to  find  which  ones  apply  to  the  stimulus. 
More  than  one  characteristic  may  apply.  Cross  out  the  characteristics  that 
do  not  apply.  Also  determine  which  response  mode  is  required  by  the  device. 
The  response  modes  are  listed  and  defined  in  Table  1.  Only  one  response 
mode  may  apply.  List  the  best  description  of  the  response  mode  in  column  IV. 

Next  rate  each  relevant  characteristic  for  each  device  that  covers  the 
skill  or  knowledge  on  how  well  it  incorporates  the  learning  guidelines  you 
listed  in  column  II.  Rate  each  applicable  characteristic  on  the  following 
scale: 


Rating 

0 

1 

2 

3 


Definition 

i 

Extremely  deficient  implementation  of  guidelines  (or)  no 
implementation  at  all. 

Partially  proficient  implementation  of  guidelines;  at  least 
minimal  implementation  is  achieved. 

Proficient  implementation  of  guidelines;  implementation  fs~ 
adequate  to  good  instructional  quality. 

Highly  proficient  implementation  of  guidelines;  implementation 
is  of  exceptional  quality  (or)  is  identical  with  guidelines. 


When  you  assign  a  rating  to  a  characteristic,  calculate  an  approximate  average 
of  how  well  the  characteristic  implements  the  complete  set  of  guidelines  in 
column  II.  Leave  the  blocks  for  PC  Score  blank... 


Functional  Characteristics  Analysis 


The  Functional  Characteristics  Analysis  is  an  extension  of  the  Physical 
Characteristics  Analysis. 

The  first  step  in  this  analysis  is  to  extract  the  learning  guidelines 
related  to  functional  characteristics  from  Appendix  B.  The  candidate  guide¬ 
lines  are  in  Appendix  B  under  the  behavioral  category  you  entered  in  column  I. 
This  time  you  are  concerned  with  the  guidelines  labelled  P/F  or  F.  List  the 
guidelines  that  apply  to  a  training  device  for  entry  level  gunners  in 
column  VI  of  the  worksheet. 


131 


Then  rate  each  device  that  covers  the  skill  or  knowledge  (C  =  l)  o: 
well  it  applies  each  guideline.  Rate  the  device  for  each  guideline  u: 
following  scale: 


Rating  Definition 

0  Extremely  deficient  implementation  of  guideline  (or)  no 

implementation  at  all. 

1  Partially  proficient  implementation  of  guideline;  at  least 

minimal  implementation  is  achieved. 


2  Proficient  implementation  of  guideline;  implementation  is 
adequate  to  good  in  quality. 

3  Highly  proficient  implementation  of  guideline;  implementation 
is  of  high  exceptional  quality  (or)  identical  with  guideline. 


Enter  your  ratings  in  column  VII.  Leave  the  FC  Score  boxes  blank. 
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TABLE  1 


GENERIC  STIMULUS  CHARACTERISTICS  AN! 
CORRESPONDING  TRAINEE  RESPONSE  MODES 


stimulus  cap*»il;ti;s 

d!  visual  fow 

1.1  tiiuil  lllMwwnc  -  words.  numbers  and  otner 
symoois  presented  graphically. 

l.J  Visual  Pictorial,  Plane  -  *  two-dimensional 
image.  a  representation  in  the  form  of  a 
pnotograoh  or  artwing. 

1.3  Visual  line  Construction,  Plane  -  e  two- 
aimensional  figure  uot  ot  lines,  suen  as 
t  mathematical  curve  or  grion. 

1.4  visual  Qb feet.  Solid  -  (  three-dimensional  image 
or  red  I  icy  (Mt  7T"viewed  from  exterior 
pertoectivct. 

1.3  visual  tnvironment  -  A  three-dimensional  image 
or  reality  tnat  is  viewed  from  inside. 

12)  VISUAL  MOVEMEMT 

2.1  visual  Still  -  a  static  visual  field,  as  with  a 
still  ono'tograpn.  drawing,  or  printed  page. 

2.2  visual  limited  Movement  -  a  basically  static 
visual  /ield  witn  elements  that  can  be  made  to 
cove,  as  with  an  animated  transparency  or  simole 
panel  with  switenes  that  move. 

2.3  Visual  full  Movement  •  a  visual  field  in  which 
al*  e'iements  can  move,  as  witn  a  motion  picture, 
flignt  simulator,  or  operational  aircraft. 

2. d  Visual  Cvclic  Movement  -  a  visual  field  which 
■oves  tnrougn  a  fixed  sequence  and  then  repeats 
tne  sequence  in  a  repetitive  manner,  as  with  a 
film  loop. 

(3)  VISUAL  SPECTHUS'. 

3. J  11  act  and  White  -  a  visual  field  comoosed  of 

eitner  Black  or  white  elements,  as  with  the 
printed  page  or  line  drawings. 

3.2  Crav  Scale  -  a  visual  field  composed  of  black, 
wmte  ana  continuous  gradations  of  gray,  as 
with  a  black  ano  unite  photograph  or 
television  picture. 

3.3  Color  -  a  visual  field  comoosed  of  various 
segments  of  the  visual  soectnaa.  as  with 
color  television  or  notion  pictures. 

(4)  SCALE 

4.1  Enact  Scale  -  actual  visual  field  or  a  one-to- 
one  replication  of  that  field  as  with  a  full- 
sited  mock-up,  simulator,  or  operational 
system. 

4.2  Proportional  Scale  -  a  representation  of 
reality  in  otner  than  full  scale,  such  as  a 
scaled  model  mao  or  pnotograoh. 

(5)  AUDIO 

$.1  voice  Sound  Panoe  -  a  limited  quality  of  sound 
wnicn  enables  tooten  words  to  oe  used  at  tne 
medium  of  coeiaunitationt,  but  not  suited  to 
more  demanding  tasks,  such  as  music  or  sound 
recognition  etcrcises. 


5.2  full  Sound  Range  -  a  Quality  of  sound  reproduction 
tnat  contains  all  the  significant  elements  of  tn» 
sound  and  is  suttee  to  tne  cemtnding  task  of  sound 
recognition  exercises. 

5.3  Ambient  Sounds  -  a  complex  sound  environment  »itn 
sounds  emanating  from  various  source!  and  're-* 
various  directions,  including  bacxgrounc  noise 
and  task  significant  souncs. 

(6)  T ACT llt-kl AESTHETIC 

6.1  Ttcticle  Cues  -  signals  received  tnrougn  tne  sente 
touch,  tnlcuoing  sensations  related  to  texture, 
site  or  shape. 

6.2  Internal  Stimulus  .lotion  Cues  -  tne  sensations  fait 
by  a  person  wnen  ne  moves  nis  ant.  leg,  fingers,  etc. 

6.3  Ekternal  Stimulus  Motion  Cues  -  the  sensations  felt  t ,. 

person  une  ne  is  moveo  by  some  outsioe  force  in  Sue*  i 
way  tnat  nit  body  experiences  roll,  pitch,  yaw,  nea.t. 
sway  and/or  surge.  ^  ■ 

TAAIWEE  »£ SPOUSE  M35f  * 

(1)  Covert  Pesoonse  •  a  response  wnicn  tne  trainee  creates 
in  ms  mind  out  ooes  not  express  in  an  ooteroabie  m»-n» 

(2)  Multiple  Choice  -  a  response  moo e  in  which  a  trainee 
selects  a  response  from  a  limited  set  of  responses. 

(3)  Pre-prooranwed  Verbal  Performance  -  a  response  mode  •* 
wnicn  a  trainee  creates  a  snort  answer  to  a  duetue*. 
having  a  limited  set  of  correct  *ns-er« 

(4)  free-Stvle  Written  Performance  -  a  resdense  noee  ir 
wnicn  a  trainee  writes  a  response  in  his  own  worcs. 

(5)  Petition  Indicator  -  a  verbal  or  perceptual  neto' 
response  in  wmen  the  trainee  indicates  that  he  net 
made  a  divergent  type  decision. 

(6)  Voice  Performance  -  a  response  mooe  in  wnicn  a  trainee 
speaks,  including  conversation. 

(7)  Fine  Movement  Manipulative  Acts  -  a  response  moot  ir 
which  a  trainee  makes  discrete  and  small  mo*e«e':t 

of  dials,  switches,  keys  or  maxes  sensitive  xcjuitrv-u 
to  insturments.  Act  may  involve  use  of  snail 
instruments. 

(8)  tread  Movement  Manipulative  Acts  -  a  response  «oee  ** 
wnicn  a  trainee  maxes  large  movements  of  levers  p' 
wheels  on  large  Pieces  of  eouioment  or  oy  tne  use  c' 
equipment  or  by.  tne  use  of  hand  ne Id  tools- 

(Sl  Tracking  -  a  response  mode  in  which  a  trainee 

continuously  controls  a  constantly  cnanging  tyltec. 
such  as  steering  an  eutenooile  or  noloing  a  compass 
bearing  in  steering  a  snip. 

(10)  Procedural  Manipulative  Acts  -  a  response  mooe  in  ur*r* 
a  trainee  performs  tne  seouence  of  steps  in  a  proceex-v 
such  as  in  the  carrying  out  of  tne  items  on  tne 
checklist  for  pre-flignting  an  aircraft  or  turning  e*>  t 
raoar  system. 


’frmn  )ust  a  few  to  many  of  these  capabilities  may  apply  to  tne  device/control  being  cneraetentee. 
*0nlv  c"f  J.-se  of  response  will  be  made  bv  tne  trainee  to  tne  corresponding  stimulus. 


Behavioral  Category  Definitions 
(Adapted  From  TRADOC  Pam.  350-30) 
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Behavioral  Category  Definitions 
(Types  of  Learning) 

Behavioral  Category  #1  —  Rule  Learning  and  Using 

•  SAMPLE  ATTRIBUTES 

1.  Choosing  a  course  of  action  based  on  applying  known  rules. 

2.  Frequently  involves  "If— then"  situations. 

3.  The  rules  are  not  questioned,  the  decision  focuses  on  whether 
the  correct  rule  is  being  applied. 

•  EXAMPLES 

1.  Apply  the  "rules  of  the  road". 

2.  Solve  mathematical  equations  (both  choosing  correct  equations 
and  the  mechanics  of  solving  the  equation).  ' 

3.  Carrying  out  military  protocol. 

4.  Selection  of  proper  fire  extinguisher  for  different  types  of 

fires.  •*— 

5.  Choosing  correct  grammar  in  novel  situations  covered  by  rules. 

Behavioral  Category  #2  —  Cl  ass 1 fyi ng-Recogni ting  Patterns 

•  SAMPLE  ATTRIBUTES 

1.  Pattern  recognition  approach  to  identification  —  not  problem 
solving. 

2.  Classification  by  non-verbal  characteristics. 

3.  Status  determination  —  ready  to  start. 


4.  Object  to  be  classified  can  be  viewed  from  many  perspectives 
or  in  many  forms. 


1.  Classify  a  sonar  target  as  "sub"  or  "non-sub". 

2.  Visual  classification  of  flying  aircraft  as  "friend"  or 
"enemy"  or  as  an  "F-4“. 

3.  Determining  that  an  identified  noise  is  a  wheel  bearing 
failure  not  a  water  pump  failure  by  rating  the  quality  of  the 
noise— not  by  the  problem  solving  approach. 

Behavioral  Category  #3  —  Identifying  Symbols 
•  SAMPLE  ATTRIBUTES 


^ J  C 
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1.  Involves  the  recognition  of  symbols  such  as  in  codes,  diagrams, 
schematics,  etc. 

2.  Symbols  to  be  Identified  typically  are  of  low  meaningful  ness 

to  untrained  persons.  1 

3.  Identification,  not  interpretation,  is  emphasized. 


EXAMPLES 


o 


c 


1.  Reading  electronic  symbols  on  a  schematic  drawing.  •* — 

2.  Identifying  map  symbols. 

3.  Reading  and  transcribing  symbols  on  a  tactical  status  board. 

4.  Identifying  symbols  on  a  weather  map. 


Behavioral  Category  #4  —  Detecting 
•  SAMPLE  ATTRIBUTES 

1.  Vigilance— detect  a  few  cues  embedded  in  a  large  block  of  time. 

2.  Low  threshold  cues;  signal  to  noise  ratio  may  be  very  low; 
early  awareness  of  small  cues. 


o 


3.  Scan  for  a  wide  range  of  cues  for  a  given  "target"  and  for 
different  types  of  "targets". 


1.  Early  sonar  detection  of  a  sumbmarine  target. 

2.  Visually  detecting  the  periscope  of  a  snorkel ing  submarine 
during  daytime. 

3.  Detect,  through  a  slight  change  in  sound,  a  bearing  starting 
to  burn  out  in  a  power  generator. 

Behavioral  Category  #5  --  Making  Decisions 

«  SAMPLE  ATTRIBUTES 

1.  Choosing  a  course  of  action  when  alternatives  are  unspecified 
or  unknown. 

2.  A  successful  course  of  action  is  not  readily  apparent. 

3.  The  penalties  for  unsuccessful  course  of  action  are  not 

v  i 

readily  apparent. 

4.  The  relative  value  of  possible  decisions  must  be  considered  — 
including  possible  trade-offs. 

•  EXAMPLES 

1.  Choosing  torpedo  settings  during  a  torpedo  attack. 

2.  Threat  evaluation  and  weapon  assignment. 

3.  Choice  of  tactics  in  combat— wide  range  of  options. 

4.  Choosing  a  diagnostic  strategy  in  dealing  with  a  malfunction 
in  a  complex  piece  of  equipment: 

5.  Choosing  to  abort  or  commit  oneself  to  land  upon  reaching  the 
critical  point  in  the  glidepath. 

Behavioral  Category  #6  —  Recalling  Bodies  of  Knowledge 

•  SAMPLE  ATTRIBUTES 

1.  Concerns  verbal  or  symbolic  learning. 

2.  Concerns  acquisition  and  long-term  maintenance  of  knowledge 
so  that  it  can  be  recalled. 
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•  iHSkii  r 

1.  Recalling  equipment  nomenclature  or  functions. 

2.  Recalling  system  functions,  such  as  the  complex  relations 
between  system  input  and  output. 

3.  Recalling  physical  laws,  such  as  Ohm's  Law. 

4.  Recalling  specific  radio  frequencies  and  other  discrete  facts. 
Behavioral  Category  #7  —  Performing  Gross  Motor  Skills 

•  SAMPLE  ATTRIBUTES 

1.  Perceptual  motor  behavior;  emphasis  on  motor.  Premium  on 
manual  dexterity,  occasionally  strength  and  endurance. 

2.  Repetitive  mechanical  skills.  • 

3.  Standardized  behavior,  little  room  for  variation  or  innovation. 


o 


4.  Automatic  behavior— low  level  of  attention  is  required  in 

skilled  operator.  Kinesthetic  cues  dominate  control  of  ^ 

behavior. 

5.  Fatigue  or  boredom  may  become  a  factor  when  skill  is  performed, 
over  an  extended  period  of  time  or  at  a  rapid  rate. 

6.  Fine  tolerances. 

7.  Often  a  component  of  a  larger  task. 

EXAMPLES 

1.  Use  of  hand  tools  such  as  hammer,  saw,  wrench,  or  power  tools 
such  as  lathes  or  grinders. 

2.  Running  a  drill  press  in  an  assembly  line. 

3.  Loading  ammunition  into  artillery  pieces  of  5"  guns. 

4.  Drafting— use  of  drafting  instruments. 

5.  Painting— house  painting  or  preserving  ship  hull,  etc. 

6.  Marching— close  order  drill. 


o 


r  ^ 


3 


168 


i  Jaieccry  =8  --  Steering  and  Guiding-Continuous  Movement 

:  SAMPLE  ATTRIBUTES 

1.  Tracking,  dynamic  control— a  perceptual  motor  skill  involving 
continuous  pursuit  of  a  target  or  keeping  dials  at  a  certain 
reading  such  as  maintaining  constant  turn  rates,  etc. 

2.  Compensatory  movements  based  on  feedback  from  displays. 

3.  Skill  in  tracking  requires  smooth  muscle  coordination  patterns— 
lack  of  overcontrol. 

4.  Involves  estimating  changes  in  positions,  velocities, 
accelerations,  etc. 

5.  Involves  knowledge  of  display-control  relationships. 

•  EXAMPLES 

-  , 

1.  Submarine  bow  and  stem  planes  operators  maintaining  a  constant 

course,  or  making  changes  in  course  or  depth. 

2.  Tank  driver  following  a  road. 

3.  Sonar  operator  keeping  the  cursor  on  a  sonar  target. 

4.  Air-to-air  gunnery— target  tracking. 

5.  Aircraft  piloting  such  as  visually  following  a  ground  path. 

6.  Helmsman  holding  a  course  with  gyro  or  magnetic  compass. 

Behavioral  Category  #9  —  Positioning  movement  and  recalling  procedures 

•  SAMPLE  ATTRIBUTES 

1.  Concerns  the  chaining  or  sequencing  of  events. 

2.  Includes  both  the  cognitive  and  motor  aspects  of  equipment 
set-up  and  operating  procedures. 

3.  Procedural  check  lists  are  frequently  used  as  job  aids. 
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1.  Recalling  equipment  assembly  and  disassembl ing  procedures. 

2.  Recalling  the  operation  and  check  out  procedures  for  a  piece 
of  equipment  (cockpit  check  lists). 

3.  Following  equipment  turn-on  procedures— emphasis  on  motor 
behavior. 

Behavioral  Category  #10  —  Voice  Comnuni eating 

•  SAMPLE  ATTRIBUTES 

1.  Speaking  and  listening  in  specialized  languages. 

2.  Often  Involves  the  use  of  a  specific  message  model.  Standard 
vocabulary  and  format. 

3.  Also  concerns  clarity  of  voice,  enunciation  and  speed. 

4.  Timing  of  verbalization  if  usually  critical— when  to  pass 
information. 

5.  Typically  characterized  by  redundancy  in  terms  of  information 
content. 

6.  Involves  extensive  use  of  previously  overlearned  verbal  skills,, 
or  overcoming  overlearned  interfering  patterns. 

7.  Tasks  may  be  difficult  due  to  background  noises. 

•  examples 

1.  Officer  giving  oral  orders  and  receiving  reports. 

2.  Sonar  operator  passing  oral  information  over  communications  net. 

3.  Instructions  by  ground  control  operator  to  pilot  in  landing 
aircraft. 


o. 
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Learning  Guidelines 
for 

Good  Instructional  Practice 


Extracted  from  TRADOC  Pam  350-30, 
Interservice  Procedures  for  Instructional 
System  Development,  Phase  III 
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LEARNING  GUIDELINES 

Behavioral  Category  #1  -  Rule  Learning  and  Using 

P  (1)  Pick  out  the  features  of  the  real  world  job  environment 
which  could  be  used  to  trigger  the  trainee’s  recall  of 
training  material  which  must  be  used  in  the  rule  using 
part  of  his  job. 

P/F  (2)  Where  possible,  supply  students  with  diagrams,  pictures, 
charts,  graphs, .rhymes,  key  words,  and  other  association 
devices  which  the  student  can  use  to  relate  what  he  al¬ 
ready  knows  to  what  he  is  trying  to  learn. 

P/F  (3)  Encourage  students  to  make  up  their  own  association 
devices  if  they  can  and  want  to  do  it. 

F  (4)  Where  the  learner  is  having  a  difficult  time  trying  to  *— 
learn  and  apply  a  rule,  use  specific  questions  which 
will  help  the  learner  to  state  the  elements  and  relation¬ 
ships  in  the  rule  and  thus  see  how  concepts  of  the  rule 
are  related. 

F  (5)  Provide  practice  until  the  student  learns  the  rules  and 
learns  to  apply  the  rules  to  the  desired  level  of  per¬ 
formance  in  the  operational  job  setting. 

i 

F  (6)  Positive  rewards  of  the  student's  correct  applications 
of  the  rules  learned  is  required  in  the  early  stages  of 
training. 
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7)  “oward  the  end  of  training,  the  level  of  positive  rewards 
for  correct  perfoVmance  should  be  reduced  to  the  same 
level  that  the  student  will  find  on  the  job. 

(8)  Relate  the  rules  to  be  learned  to  operational  tasks  which 
the  trainee  must  perform  in  real  world  assignments. 

(9)  Different  trainees  will  have  different  rates  and  styles 
of  learning  the  material.  Use  techniques  which  allow 
students  flexibility  in  learning  time. 

(10)  Reduce  forgetting  by  providing  periodic  practice  or  re¬ 
fresher  training  for  infrequently  used  material. 

(11)  In  order  for  slower  learners  to  reach  the  same  level  of 

i 

proficiency  as  faster  learners,  time  must  be  allowed  for 
the  slower  learner  to  get  as  many  positive  rewards  for 
correct  applications  of  the  rules  learned  as  the  faster 
learner. 

(12)  At  the  beginning  of  the  training,  the  instructor  or  the 
material /media  should  clearly  inform  the  trainee  of  the 
learning  objectives;  that  is,  what  the  trainee  is  ex¬ 
pected  to  be  able  to  do  by  the  completion  of  training. 

(13)  Make  sure  that  the  student  can  recall  and  demonstrate 
the  concepts  which  make  up  the  rule;  then  go  on  to  rule 
learning. 

(14)  Require  the  learner  to  state  the  rule  verbally  in  the 
learner's  own  words.  This  helps  the  learner  recall  which 
concepts  make  up  the  rule  and  how  the  concepts  are  ar¬ 
ranged. 
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F  (15)  Present  examples  of  when  the  rule  applies  and  when  it 
doesn't. 

F  (16)  Provide  opportunities  to  apply  the  rule  in  a  variety  of 
new  situations  in  which  the  learner  has  not  previously 
been  trained  to  apply  the  rule. 

F  (17)  During  practice,  practical  applications  and  practice 
tests,  provide  the  student  with  immediate  knowledge  of 
results  about  his  correct  and  incorrect  answers. 

F  (18)  Provide  rewards  for  correct  application  of  the  rule. 

F  (19)  To  test  the  learner's  understanding  of  the  rule,  provide 

an  unfamiliar  situation  in  which  the  rule  can  be  applied, 
and  then  require  the  learner  to  tell  how  the  concepts  of 
the  rule  are  related  to  each  other  and  to  this  situation. 
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LEARNING  GUIDELINES 


3ehavioral  Category  #2  -  Classifying/Recognizing  Patterns 

P/F  (1)  Call  students  attention  to  the  important,  distinctive 
features  and  characteristics  of  a  pattern  which  distin¬ 
guish  this  pattern  from  other  patterns. 

P/F  (2)  Clearly  display  each  of  the  distinctive  features  of  pat¬ 
terns  under  study.  Show  "how  these  cues  differ  from  each 
other  (pre-differentiation  of  stimuli). 

P/F  (3)  Determine  if  the  trainee  can  detect  distinctive  features 
in  patterns  that  are  not  to  be  classified  or  recognized 
(ignored)  in  the  training  task. 

P/F  (4)  Emphasize  distinctive  features  which  can  be  remembered  in 
the  form  of  mental  "pictures"  instead  of  abstract  words*— 
When  possible,  supply  students  with  diagrams,  pictures, 
charts,  graphs,  rhymes,  acronyms,  keywords,  self  in¬ 
structions,  common  associations,  and  other  association 
devices  like  these  to  which  the  student  can  relate  the 
material  he  is  trying  to  learn. 

P/F  (5)  Teach  students  to  transform  distinctive  features  of  the 
patterns  into  items  that  they  can  readily  recall  and 

f 

make  correct  actions  to. 

P/F  (6)  In  instructional  presentations  and  practice,  many  examples 
and  non-examples  of  the  pattern  should  be  presented. 


(7)  Toward  the  end  of  training,  present  examples  and  non¬ 
examples  of  patterns  that  will  be  very  similar  to  each 
other  in  the  job  environment. 

P/F  (8)  In  early  training  there  should  be  few  irrelevant  features, 
so  that  identifying  the  distinctive  characteristics  of 
the  pattern  is  fairly  easy. 

P/F  (9)  By  the  end  of  training,  the  number  of  irrelevant  cues 
surrounding  distinctive  characteristics  should  be  in¬ 
creased  to  correspond  with  the  real-life  situation/job 
setting. 

P/F  (10)  Provide  the  student  with  practice  in  recognizing  examples 

i 

from  the  full  range  of  patterns  produced  by  a  given  ob¬ 
ject.  Make  the  examples  more  similar  as  training  pro¬ 
gresses.  At  the  end  of  training,  the  similarities  in 
the  examples  should  be  the  similarities  that  exist  in  <=“*’ 
the  real  world. 

P/F  (11)  Provide  a  variety  of  examples  of  the  pattern.  Select 

examples  from  the  full  range  of  variations  in  the  pattern. 

P/F  (12)  To  test  learning,  require  the  trainee  to  provide  new 
examples  of  the  pattern,  and  to  teach  recognition  of 
— ^  the  pattern  to  someone  else. 

F  (13)  At  the  beginning  of  the  training,  the  instructor  or  the 
materials  should  clearly  inform  the  trainee  of  the 
training  objectives;  that  is,  what  the  trainee  is  ex¬ 
pected  to  be  able  to  do  by  the  completion  of  training. 
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(K)  Organize  the  training  material  in  such  a  way  that  the 
trainee  can  meet 'the  training  objectives  at  the  end  of 
training. 

(15)  Relate  the  objectives  and  learning  activities  to  opera¬ 
tional  tasks  which  the  trainee  must  perform  in  future 
real  world  assignments. 

(16)  Positive  rewards  of  the  students'  correct  recognition  of 
patterns  is  required  in  the  early  stages  of  training. 

(17)  Toward  the  end  of  training,  the  level  of  positive  rewards 
for  correct  performance  should  be  reduced  to  the  same 
level  that  the  student  will  find  on  the  job. 

i 

(18)  Provide  plenty  of  opportunities  for  students  to  practice 
making  recognitions  of  each  pattern  being  learned. 

(19)  In  practice  and  practice  tests,  provide  for  immediate 
knowledge  of  results  to  help  the  student  meet  the  learning 

t 

objectives  by  making  each  action  of  the  task  correct. 

(20)  The  pause  following  knowledge  of  results  should  be  long 
enough  to  allow  the  student  time  to  sort  out  his  errors 
and  pick  out  distinctive  features  of  the  pattern  to  be 
classified. 

(21)  Different  trainees  will  have  different  rates  and  styles 
of  learning  the  material,  Provide  flexibility  in  the 
time  allowed. 

(22)  In  order  for  slower  learners  to  reach  the  same  level  of 
proficiency  as  faster  learners,  time  must  be  allowed  for 
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the  slower  learner  to  get  as  many  or  more  positive  rewards 
for  correct  answers  as  the  faster  learner. 

(23)  3e  sure  that  students  develop  a  strong  tendency  to  look 
for  certain  critical  and  distinctive  patterns  and  develop 
the  same  kind  of  expectations  they  will  need  to  have  while 
on  the  job. 

(24)  Require  the  student  to  overlearn  the  original  material; 
that  is,  the  student  should  continue  to  practice  the  re¬ 
quired  tasks  after  the  point  that  simple  mastery  of  the 
task  has  been  met. 

(25)  Reduce  forgetting  by  providing  periodic  opportunity  to 
recall  and  apply  infrequently  used  material. 


LEARNING  GUIDELINES 


Behavioral  Category  #3  -  Identifying  Symbols 

P  (1)  Pick  out  features  of  the  real  world  job  environment  which 
could  be  used  to  spark  the  trainees'  recall  of  associated 
material  which  would  likely  be  used  in  the  job  or  its 
parts. 

P/F  (2)  If  there  are  very  similar  symbols  (or  features  of  parts 

of  symbols)  which  have  been  frequently  confused  in  the  past, 
then  be  sure  that  the  students  can  tell  the  difference 
between  the  symbols  (or  their  parts)  before  they  ar*e  taught 
actions  to  take  for  each  one. 

P/F  (3)  During  instruction,  the  presentation  of  the  symbol  should 
be  followed  immediately  by  the  presentation  of  its  meaning 
(contiguity  principle). 

P/F  (4)  When  possible,  supply  students  with  diagrams,  pictures, 
.charts,  graphs,  rhymes,  acronyms,  key  words,  and  other 
association  devices  to  which  the  student  can  relate  what 
he  is  trying  to  learn. 

r 

F  (5)  Clearly  relate  the  learning  objectives  and  learning  acti¬ 
vities  to  operational  tasks,  which  the  trainee  must  per- 
form  in  future  real  world  assignments. 

F  (6)  Break  the  overall  learning  task  down  into  manageable  steps 
or  units  when  any  of  the  following  conditions  exist: 


a.  lower  ability  students 

b.  complex  material 

c.  overall  task  contains  many  small  parts 

F  (7)  Change  the  order  of  presenting  material  during  practice 
so  that  each  training  item  will  be  learned  equally  well. 

F  (8)  Encourage  the  students  to  make  up  their  own  association 
devices  if  they  can  and  want  to. 

F  (9)  When  possible,  provide  the  students  with  association  de¬ 
vices  which  will  cause  an  emotional  reaction  in  the  student. 

F  (10)  Allow  for  self-paced  practice  and  provide  the  student 
with  knowledge  of  the  results  of  his  identifications. 

i 

F  (11)  Reduce  forgetting  by  providing  periodic  recall  and  prac¬ 
tice  for  infrequently  used  material. 

F  (12)  Require  the  student  to  overlearn  the  original  material; 

that  is,  the  student  should  continue  to  practice  the  re^~~ 
quired  tasks  after  the  point  that  simple  mastery  of  the 
task  has  been  met. 

F  (13)  Practice  and  test  situations  should  require  the  student 
to  make  written  or  verbal  answers  so  that  the  accuracy  of 
his  recall  can  be  checked. 

F  (14)  Different  trainees  will  have  different  rates  and  styles 

of  learning  the  material.  Provide  flexibility  in  learning 
time  a lotted. 

F  (15)  Positive  reward  of  the  student's  correct  identification  of 
symbols  and  provision  of  immediate  knowledge  of  result  is 
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required  in  the  early  stages  of  training. 

(16)  Toward  the  end  of* training,  the  level  of  positive  re¬ 
wards  and  knowledge  of  results  should  be  reduced  to  the 
same  level  that  the  student  will  find  on  the  job. 
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LEARNING  GUIDELINES 


P/F  (1) 

P/F  (2) 

P/F  (3) 

P/F  (4) 

P/F  (5) 


Behavioral  Category  #4  -  Detecting 
Train  student  to  use  systematic  search  procedures 
utilizing  whatever  senses  (sight,  hearing,  etc.)  are 
appropriate  for  the  task. 

Provide  examples  of  correct  performance  of  the  task 
where  appropriate. 

In  presenting  signals,  sample  from  the  full  range  of 
types  of  signals.  Include  the  different  signal  sources 
to  be  encountered  on  the  job  and  the  different  patterns 
of  each  signal  source.  1 

Train  the  student  to  use  the  detected  signal  as  a  cue 
to  search  for  and  verify  the  existence  of  the  signal  in 
a  second  sense  modality,  where  it  is  possible  for  the 
signal  to  be  detected  by  more  than  one  sense,  and  when 
a  student  thinks  he  has  detected  the  signal  through  one 
sense. 

Where  appropriate,  train  the  student  to  use  peripheral 
vision  when  scanning  with  the  eyes. 


•  The  following  (6  -  11)  are  guidelines  for  managing  earlier 

f 

stages  of  training. 

P/F  (6)  Provide  a  high  signal  density  more  frequent  than  in  the 
operational  task. 


0 
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3/F  (7)  Signals  snoula  have  high  signal -to-noise  ratio 

P/F  (8)  Use  different  amounts  of  time  between  signal  presentation. 
P/F  (9)  Insure  a  high  frequency  of  student  identifications  of 
the  signal . 

P/F  (10)  Provide  student  with  immediate  and  continuous  knowledge 
of  results 

P/F  (11)  Oo  not  teach  any  vigilance  techniques 

•  The  following  (12  -  16)  are  guidelines  for  managing  intermediate 
stages  of  training. 

P/F  (12)  Use  a  lower  signal  density  1 

P/F  (13)  Use  lower  signal -to-noise  ratios 

P/F  (14)  Use  different  amounts  of  time  between  signal  presentations. 
P/F  (15)  Provide  student  with  intermittent  knowledge  of  results.-* **— 
P/F  (16)  Introduce  vigilance  techniques 

•  The  following  (17  -  21)  are  guidelines  for  managing  advanced 

■  stages  of  training. 

**  — 

fVF  (17)  Low  signal  density;  i.e.,  operational  density  or  minimum 
number  suited  to  training. 

P/F  (18)  Decrease  signal-to-noise  ratio  to  operational  level 

P/F  (19)  Use  different  amounts  of  time  between  signal  presentations. 

P/F  (20)  Provide  the  student  with  knowledge  of  results  equivalent. 

P/F  (21)  Require  vigilance  techniques  appropriate  to  the  job  setting. 
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'F  ;22)  “rain  tne  student  io  monitor  his  own  vigilance  level 

by  conditioning  him  to  respond  to  biological  conditions 
(internal  cues)  which  appear  when  vigilance  begins  to  fade. 

(23)  At  the  beginning  of  the  training,  the  instructor  or  the 
material /media  should  clearly  inform  the  trainee  of  the 
learning  objectives;  that  is,  what  the  trainee  is  ex¬ 
pected  to  be  able  to  do  by  the  completion  of  training. 

(24)  Relate  the  learning  objectives  and  learning  activities 
to  operational  tasks  which  the  trainee  must  perform  in 
future  real  world  assignments. 

(25)  Train  the  student  in  techniques  of  vigilance;  trairyhim 
to  establish  a  mental  "set"  to  search.  Use  instructions 
to  establish  this  "set"  and  provide  a  positive  reward 
when  the  student  achieves  a  proper  "set." 

(26)  Provide  knowledge  of  results  on  correct  detections.  This 
can  serve  as  positive  reward  to  encourage  vigilance 
behaviors  that  will  lead  to  continued  correct  detections. 

(27)  Ensure  that  detections  are  correct  before  providing  posi¬ 
tive  reward. 

(28)  Do  not  allow  a  student  to  leave  one  phase  or  level  of 

the  learning  task  until  he  has  achieved  the  required 
level  of  mastery.  * 
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LEARNING  GUIDELINES 


CX 

Behavioral  Category  #5  -  Making  Decisions 


P/F  (1) 


P/F  (2) 


P/F  (3) 


F  (4) 


Provide  the  student  with  a  wide  variety  of  decision 
making  experiences.  Provide  basic  problems  where  there 
are  only  a  few  factors  to  consider.  Also  provide  complex 
problems  which  require  the  student  to  consider  many 
factors.  Tlv  solutions  should  range  from  easy  to  hard. 

If  the  trainee  will  be  required  to  make  the  decision 
under  stress  in  the  real  world,  then  he  must  overlearn 
the  decision  making  skill  during  training.  That  is,  he 
must  be  able  to  make  the  correct  decision,  and  he  must 
be  able  to  make  the  decision  efficiently,  accurately, 
and  repeatedly  in  distracting  surroundings. 

During  the  final  stages  of  training,  tt  is  important  to 
provide  situations  which  closely  duplicate  the  real  world 
with  respect  to  amount  of  data,  type  of  data,  amount  of 
time  to  complete  the  decision  making  problems,  and  the 
amount  of  distraction  and  "noise"  in  the  working  environ¬ 
ment. 

At  the  beginning  of  the  training,  the  instructor  or  the 

* 

materials  should  clearly  inform  the  trainee  of  the  learning 
objectives;  that  is,  what  the  trainee  is  expected  to  be 
able  to  do  by  the  completion  of  training. 


O 


o 


O* 


o 


o 


(5)  At  the  beginning  of  training,  relate  the  learning  ob¬ 


jectives  and  learning  activities  to  operational  tasks 


which  the  trainee  must  perform  in  future  real  world 


assignments. 


(6)  For  the  most  efficient  learning  of  decision  making  the 


student  must  already  have  learned  the  technical  knowledge 
which  will  allow  him  to  identify  what  the  problem  really 


is,  make  a  list  of  the  most  reasonable  solutions,  and 


determine  which  of  the  solutions  would  be  best. 


(7)  The  student  will  learn  best  if  he  is  not  afraid  of  making 
incorrect  decisions  in  the  training  situations;  thi^  is 
particularly  true  in  the. early  stages  of  training  and  in 


very  complex  decision  making  processes.  Materials  and 


instructors  should,  therefore,  attempt  to  decrease  student 


fears  to  a  low  level. 


(8)  Give  the  students  examples  of  these  two  types  of  actions 


which  are  to  be  avoided  when  making  decisions: 


a.  response  biases;  that  is,  the  tendency  to  make  a 


"favorite"  decision  or  use  a  "favorite"  solution 


regardless  of  the  real  nature  of  the  problem. 


b.  perceptual  sets;  that  is,  the  tendency  to  generalize 


problems  or  view  several  types  of  problems  as  if 


they  were  all  the  same  when,  in  fact,  they  are  quite 


different. 


^9)  Teach  the  students  a  set  or  steps  to  follow  in  making 
decisions  such  as'  the  following  5-step  model: 

a.  Discover  the  existence  of  a  problem  and  define  it 

b.  Identify  and  collect  relevant  information 

c.  Develop  reasonable  solutions  to  the  problem 

1)  compare  alternative  solutions 

2)  combine  alternate  solutions  where  desirable 

d.  Evaluate  each  of  the  proposed  solutions. 

1)  how  will  each  solution  solve  the  problem? 

2)  will  each  solution  bring  about  any  additional 
benefits  or  problems? 

3)  rank  each  solution  according  to  the  results 


o. 


% 
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>\ 

A 
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it  would  bring. 

e.  Decide  on  the  best  solution  and  put  it  into  effect. 

(10)  Provide  the  student  with  enough  realistic  information  and 
data  on  which  to  formulate  possible  solutions  and  make 
final  decisions.  Be  sure  th*at  the  student  makes  decisions 
in  the  same  variety  of  settings  as  he  will  face  in 
carrying  out  his  job. 

(11)  Provide  the  learner  with  knowledge  of  results  for 

each  decision  he  makes.  A  recommended  list  of  questions 
to  ask  about  the  learner's  problem  solutions  follows: 

a.  Predictable?  (Were  evidences  of  perceptual  sets  shown 
in  his  solution?) 

b.  Perseverated?  (Were  evidences  of  response  biases 
shown  in  solution?) 


o 


o 
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c.  Timely?  (Is  this  the  appropriate  time  to  execute 
this  particular  oecision?) 

d.  Complete?  (Oid  he  consider  all  of  the  data  and 
information?) 

e.  Consistent?  (Is  his  solution  compatible  and  relevant 
to  the  data  and  the  available  information?) 

F  (12)  Give  knowledge  of  results  with  respect  to  the  student's 
decisions  each  time.  Where  possible,  provide  the  actual 
consequences  of  the  learner's  decision.  . 
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LEARNING  GUIDELINES 

8ehavioral  Category  sf6  -  Recalling  Bodies  of  Knowledge 


I 


P  (1)  Arrange  for  features  of  the  real  world  job  setting  to  be 

used  to  trigger  the  trainee's  recall  of  training  material  — 
the  knowledge  he  needs  to  do  the  job. 

P  (2)  Use  high  interest,  attention-getting  features  of  the 

learning  materials  throughout  the  training.  Keep  student 

,  i 

attention  by  using  learning  activities  which  require 
active  student  participation. 

P/F  (3)  Make  the  learning  activities  relevant  by  making  them 

similar  to  real-life  tasks  that  the  student  will  be  per¬ 
forming  on  the  job. 

P/F  (4)  If  the  real  world  job  will  present  the  trainee  with  very 
similar  features  of  the  job  situation  which  will  require 

a 

the  trainee  to  remember  different  knowledge  for  each 
feature,  make  sure  that  the  trainee  learns  the  difference 
between  these  features  before  he  is  taught  which  body  of 
knowledge  to  associate  with  each  feature. 

P/F  (5)  When  possible,  supply  students  with  diagrams,  pictures, 
charts,  graphs,  rhymes,  acronyms,  key  words,  and  other 
association  devices  to  which  the  student  can  relate  the 
facts  and  principles  he  is  trying  to  learn  and  recall 
them  more  easily. 

P/F  (6)  Tn  early  phases  of  training,  provide  the  student  with 
guides,  prompts,  cues,  and  coaching  which  will  help  him 


i 

i 
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remember  the  material  correctly. 


P/F  (7)  As  training  progresses,  prompts  should  be  reduced  until 
it  matches  the  level  of  help  that  will  be  available  in 
the  real  world  job  setting. 

P/F  (8)  Provide  students  with  opportunities  to  practice  their 

t 

training  tasks  by  setting  up  a  wide  variety  of  testing 
and  practice  situations  which  are  very  similar  to  situa¬ 
tions  the  learner  will  encounter  on  the  job. 

P/F  (9)  Practice  and  test  situations  should  require  the  student 
to  make  written  or  verbal  answers  so  that  the  accuracy 
of  his  recall  of  the  facts  and  principles  he  learned  can 

i 

be  checked. 

F  (10)  At  the  beginning  of  the  training,  the  instructor  or  the 
material/media  should  clearly  inform  the  trainee  of  the 
learning  objectives;  that  is,  what  the  trainee  is  ex- 
pected  to  be  able  to  do  by  the  completion  of  training  to 
meet  the  learning  objectives. 

F  (11)  Analyze  the  subject  body  of  knowledge  to  detect  key  words, 
formulas  or  phrases.  Organize  the  learning  activities 
around  these  key  items. 

F  (12)  Before  testing  for  recall,  provide  some  warm-up  exercises 
(or)  an  introduction  to  remind  the  student  of  the  type 
of  task  and  the  type  of  information  needed. 

F  (13)  If  it  is  necessary  for  the  student  to  learn  similar 
bodies  of  subject  matter,  then  directly  compare  the' 
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boaies  when  they  are  first  presented  so  that  the  student 

< 

can  tell  them  apart  (or)  separate  their  presentation  by 
as  much  time  as  possible  to  avoid  confusion  between  them. 

(14)  Encourage  and  give  students  directions  to  make  up  their 
own  association  devices  if  they  can  and  want  to. 

(15)  When  possible,  provide  students  with  association  devices 
which  will  cause  an  emotional  reaction  in  the  student. 

(16)  During  the  training  sessions,  provide  the  student  with 
immediate  knowledge  of  results  about  his  correct  and  in¬ 
correct  answers. 

(17)  Provide  positive  rewards  during  the  instruction,  evpn 
during  non-testing  situations.  Reward  a  student's  pro¬ 
gress,  attitude,  attention,  mastery  of  an  objective,  etc. 

(18)  In  practice  and  practice  tests,  provide  for  immediate 

T- 

knowledge  of  results  to  help  the  student  retain  correct 
answers  and  eliminate  incorrect  answers. 

09)  Change  the  order  of  presenting  the  material  during 

practice  so  that  each  item  in  the  list  will  be  learned 
equally  well. 

(20)  Rest  periods  should  be  provided  during  practice  sessions 
according  to  need  for  rest  as  judged  by  the  student  and 
requirements  of  the  specific  learning  material  as  judged 
by  the  instructor. 

(21)  Different  trainees  will  have  different  rates  and  styles 
of  learning  the  material.  Try  to  provide  flexibility  in 


time  to  learn. 


r  (22)  In  order  for  slower  learners  to  reach  the  same  level  of 
proficiency  as  faster  learners,  time  must  be  allowed  for 
the  slower  learner  to  get  as  many  or  more  positive  rewards 
for  correct  answers  as  the  faster  learner. 

F  (23)  As  training  continues,  give  the  learner  chances  to  compare 
his  progress  and  achievement  with  the  stated  learning  ob¬ 
jectives. 

F  (24)  Test  to  see  that  the  student  is  able  to  correctly  recall 
key  features  that  will  help  him  recall  the  knowledge  he 
needs  in  performing  his  job. 

F  (25)  Provide  the  student  with  practice  in  associating  the 
knowledge  to  be  learned  with  key  features  of  the  job 
setting. 

F  (26)  Prevent  forgetting  by  showing  the  meaningful  ness  of  the 

material  to  the  learner's  job  environment  and  duties.  *“* 
Emphasize  the  organization  and  structure  of  the  material. 

F  (27)  Require  the  student  to  overlearn  the  original  material; 

that  is,  the  student  should  continue  to  practice  the 

*  • 

required  tasks  after  the  point  that  simple  mastery  of 
the  training  task  has  been  met.  , 
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3ehavioral  Category  47  -  Performing  Gross  Kotor  Skills 

» 

»  (1)  Teach  the  learner  to  tell  the  difference  between  similar 

external  cues  (conditions,  features,  characteristics,  etc. 
or  objects  in  the  job  environment  to  which  the  learner 
must  respond  with  an  appropriate  action)  like  knowing  when 
too  much  pressure  is  put  on  a  power  saw  the  wood  begins 
to  smoke. 

3  (2)  Teach  the  learner  to  tell  the  difference  between  similar 

internal  cues  (muscular  feelings  inside  one's  body  which 
guide  the  execution  of  a  physical  skill  and  allow  automatic 
responses)  like  knowing *by  the  "feel"  of  the  power  saw  how 
much  pressure  to  use  without  burning  the  wood. 

P/F  (3)  Early  in  training,  present  immediate  and  specific  knowledge 
of  results  to  the  student.  • 

P/F  (4)  Early  in  training,  present  external  cues  that  will  bring 
out  the  desired  responses  in  the  student's  actions. 

P/F  (5)  Later  in  training,  training  should  reduce  the  knowledge 
of  performance  results  to  on-the-job  levels. 

P/F  (6)  Later  in  training,  training  should  train  the  student  to 
respond  to  Internal  cues  in  his  muscles  to  guide  his 
actions  in  correctly  performing  the  task. 

P/F  (7)  If  students  make  incorrect  actions  or  begin  to  develop 
.bad  habits,  a  penalty  is  presented  following  these 
Improper  responses  until  they  disappear. 


P/F  (9) 


P/F *  (10) 


P/F  (11) 


P/F  (12) 


P/F  (13) 


To  insure  that  the  learner  understands  the  required  task, 
tne  training  media  should  independently  demonstrate/correct 
performance  of  the  task. 

To  insure  that  the  learner  understands  required  subtasks, 
the  training  media  should  independently  demonstrate 
component  parts  of  the  task. 

To  insure  that  the  learner  understands  required  task 
and  subtasks,  training  media  permits  the  instructor/ 
student  to  describe  and/or  demonstrate  the  desired 
task  and  its  component  parts. 

Provide  for  learner  practice  on  parts  (specific  components) 
of  the  task  for:  , 

1)  simple  task-practice  In  entirety 

2)  complex  task  practice  in  parts  and  then  in  entirety 
Provide  for  learner  practice  under  varied  conditions 

so  as  to: 

1)  facilitate  the  performance  of  the  motor  task 

2)  help  adapt  the  performance  of  this  task  to 
potential  environmental  changes 

Ensure  that  during  practice  the  learners: 

1)  understand  the  objectives  of  the  skill  while  learning 

2)  can  observe  a  skilled  performance  of  the  desired  task 


as  often  as  necessary  * 

3)  can  obtain  knowledge  of  results  concerning  his 
performance  of  the  task 


o 


P/F  (14)  Ensure  that  during  practice  the  learners  have  short  rest 
periods  mixed  in  with  the  practice  methods 


F 


F 


F 


F 


F 


F 


F 


» 15)  Voviae  real  life  distractions,  interruptions,  and 
"noise"  to  the  level  that  the  person  will  encounter 

t 

on-the-job,  when  and  where  appropriate. 

(16)  At  the  beginning  of  training,  the  learning  objective  is 
made  clear  and  apparent  to  the  trainee. 

(17)  At  the  beginning  of  training,  the  trainer  clearly  relates 
the  learning  objectives  and  learning  activities  to  opera¬ 
tional  tasks  which  the  trainee  must  perform  in  future  real 
world  assignments. 

(18)  Feed  back  to  student  knowledge  of  results;  student  learns: 

1)  what  he  Is  doing  right 

2)  what  he  is  doing  wrong  i 

(19)  Feed  back  to  student  comparisons;  student  learns  how  what 
he  did  compares  to  the: 

1)  learning  objectives  of  the  program 

2)  correct  demonstration  of  task 

3)  standards  that  are  required  in  operational  setting 

(20)  The  pause  following  knowledge  of  results  should  be  long 
enough  to  allow  the  student  time  to  sort  out  his  errors 
and  to  rest  his  muscles. 

(21)  Reward  performances  which  are  closer  to  the  goal  than  the 
preceeding  performances.  In  this  manner,  the  student's 
performance  will  become  successively  closer  to  the  desired 
performance  (shaping). 

(22)  After  the  student  successfully  reaches  the  desired 
performance,  reduce  the  frequency  of  reward  to  the 
level  found  on  the  job. 
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r  3'  Require  the  student  to  overlearn  the  original  material; 
that  is,  the  student  should  continue  to  perform  the 
required  tasks  after  the  point  that  simple  mastery  of 
the  task  has  been  met. 

F  (24)  Allow  for  individual  variation  in  physical  coordination 
and  provide  extra  time  and  practice  for  those  who  learn 
the  skills  less  readily. 

F  (25)  Reduce  forgetting  by  providing  periodic  practice  for 


infrequently  used  skills. 


LEARNING  GUIDELINES 


Behavioral  Category  =8  -  Steering 
and  Guiairrg/Continuous  Movement 

P  (1)  Critical  cues,  from  which  the  trainee  gets  feedback  on  how 

well  the  task  was  performed,  must  be  realistic  and  continually 
available  during  the  performance  of  the  task. 

P  (2)  In  continuous  control  task  training,  maintain  a  high  level 
of  real  world  conditions  in  the  presentation  of  cues 
to  which  the  trainee  must  react,  the  actions  and  reactions 
which  the  trainee  makes,  and  the  way  that  the  displays  and 
controls  of  the  system  continuously  respond  to  the  trainee's 
control .  1 

P/F  (3)  Demonstrate  correct  task  performance  with  a  model. 

P/F  (4)  Provide  practice  under  a  variety  of  conditions. 

P/F  (5)  Provide  practice  on  specific  component  skills  when  learning 

complex  tasks. 

P/F  (6)  Give  the  student  knowledge  of  results  on  small,  distinct 
segments  of  his  performance,  especially  during  early 
stages  of  learning. 

P/F  (7)  Teach  the  student  to  scan  continuously  by  specific  training 
of  eye  movement  and  where  to  focus  for  scanning. 

F  (8)  At  the  beginning  of  the  training,  the  instructor  or  the 
materials  should  clearly  inform  the  trainee  of  the 
learning  objectives. 

F  (9)  Relate  the  learning  objectives  and  activities  to  operational 
tasks  which  the  trainee  must  perform  in  future  real  world 
assignments. 
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10)  Provide  a  preview  of  important,  selecteo  motions  and 
movements  that  the  student  will  learn  to  make. 

F  (11)  Break  the  overall  learning  task  down  into  manageable  steps 
or  unit  when  any  of  the  following  conditions  exist: 

a.  lower  ability  students 

b.  complex  material 

c.  the  overall  task  contains  many  small  parts 
and  is  so  long  that  the  student  or  instructor 

thinks  that  only  a  part  of  it  at  a  time  should 

. 

be  learned. 

F  (12)  Highly  skilled  performance  requires  extensive  practice; 

This  practice  should  provide: 

a.  an  understanding  of  skill  objectives 

b.  the  student  can  observe  skill  performances 

c.  the  student  is  given  adequate  opportunity  to 
practice  on  the  task 

d.  student  receives  knowledge  of  results 

e.  rest  periods  to  be  mixed  in  with  the  practice 
periods  when  the  trainee  feels  that  he  needs  them. 

F  (13)  Positive  reward  should  be  provided  for  performances  which  ere 
closer  to  goal  than  preceeding  performances.  In  this  manner, 
the  student's  performance  will  become  successively  closer 
to  the  desired  performance  (shaping). 

F  (14)  Positive  reward  should  follow  as  soon  as  possible  after 
each  correct  student  performance;  initially  after  each 
distinct  segment  of  performance  and  toward  the  end  of 
training  after  each  maneuver  or  complete  evolution. 
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Behavioral  Category  ~9  -  Positioning  Movement 
and  Recalling  Procedures 

P  (1)  Provide  a  visual  demonstration  of  the  physical  skill  that 
the  trainee  is  expected  to  perform  at  each  step  in  the 
checklist  of  procedures. 

P  (2)  Pick  out  features  of  the  real  world  job  environment  which 
could  be  used  to  spark  the  trainees'  recall  of  training 
material  which  must  be  used  in  that  part  of  his  job. 

P  (3)  Provide  realism  for  procedural  and  physical  skills  practice: 

a.  equipment  realism  can  be  at  a  minimum  level; 
for  example,  a  photo  of  the  job  setting  or1  a 
paper  and  plywood  model 

b.  checklist  items  and  their  corresponding  procedural 
responses  need  to  be  as  realistic  as  possible  __ 

P/F  (4)  Break  the  physical  skills  (positioning  movement)  into 
logical  sub-units  or  part  skills.  Then  make  sure  that 
the  procedural  steps  for  each  of  these  sub-units  are  well 
organized. 

P/F  (5)  Break  the  overall  learning  task  down  into  manageable  steps 

r 

or  units  when  any  of  the  following  conditions  exist: 

a.  lower  ability  students 

t 

b.  complex  material 

c.  overall  task  contains  many  small  parts 

P/F  (6)  If  the  checklist  presents  the  trainee  with  similar  checklist 
items  which  in  the  past  have  been  frequently  confused,  then 
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P/F  (7) 


P/F  (8) 

P/F  (9) 
P/F  (10) 
P/F  (11) 

P/F  (12) 
P/F  (13) 

• 

P/F  (14) 
P/F  (15) 
P/F  (16) 
P/F  (17) 

P/F  (18) 
P/F  (19) 


be  sure  that  the  trainee  can  explain  the  differences 
between  these  similar  checklist  items  before  he  is  taugnt 
which  action  to  take  for  each  one. 

When  possible,  supply  students  with  diagrams,  pictures, 
charts,  graphs,  rhymes,  acronyms,  key  words,  and  other 
association  devices  like  these  to  which  the  student  can 
relate  the  material  he  is  trying  to  learn. 

The  following  (8-13)  are  guidelines  for  providing  the  trainee 
with  practice: 

Ensure  that  the  trainee  has  a  lot  of  opportunity  to  practice 
physical  skills  early  in  the  training. 

Be  sure  the  trainee  understands  the  learning  objectives. 
Provide  a  visual  demonstration  of  the  correct  performance 
Allow  the  trainee  to  practice  part-skills  and  provide 
feedback  to  train  him  to,  perfect  the  movement. 

Integrate  the  part-skills  into  a  smooth  sequence. 

Provide  feedback  so  the  trainee  can  improve  his  performance. 
The  following  (14-19)  are  guidelines  for  managing  earl ier 
stages  of  training. 

Provide  immediate  and  frequent  knowledge  of  results. 

Provide  immediate  and  frequent  positive  reward. 

Provide  few  or  no  distractions 

Learning  material  should  be  broken  'down  into  small,  easily 
learned  parts. 

Items  should  be  relatively  easy  to  learn 

Provide  guides,  prompts,  cues,  and  coaching  to  aid  learning. 
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P/F  (20) 
P/F  (21) 

P/F  (22) 

P/F  (23) 

P/F  (24) 

P/F  (25) 
F  (26) 

F  (27) 

F  (28) 

F  (29) 

F  (30) 


“he  following  (20-25)  are  guidelines  for  managing  later 

stages  of  learning. 

< 

Provide  occasional,  delayed  feedback. 

Provide  occasional,  delayed  reward  of  students'  correct 
movements . 

Oistractions  and  interferance  should  be  similar  to  what 
will  be  found  on  the  job. 

Learning  material  to  be  recalled  and  used  should  be  as  it 
would  be  found  on  the  job. 

Learning  material  should  be  as  complex  as  that  to  be  used 
on  the  job. 

Use  no  guides  or  prompts  that  would  not  be  found  on  the  job. 

At  the  beginning  of  the  training,  the  instructor  or  materials/ 
media  should  clearly  inform  the  trainee  of  the  learning 
objectives.  ___ 

Organize  the  training  material  in  such  a  way  that  the  trainee 
can  easily  identify  and  achieve  the  learning  objectives 
throughout  the  training. 

Relate  the  objectives  and  learning  activities  to  operational 
tasks  which  the  trainee  must  perform  in  future  real  world 
assignments. 

Encourage  the  students  to  make  up  their  own  association 

devices  If  they  can. 

When  possible,  provide  students  with  association  devices 
which  will  cause  an  emotional  reaction  in  the  student. 


i*31)  To  help  students  remember  a  chain  of  procedures,  it  is 
useful  to  practice  identifying  checklist  items.  Some 
examples  are: 

a.  identifying  each  checklist  item  and  explaining 
or  performing  its  corresponding  procedure 

b.  identifying  a  group  of  checklist  items  (as  many 
as  the  student  can  handle  at  once)  and  explaining 
or  performing  their  corresponding  procedural 
steps;  the  first  items  of  each  group  should  over¬ 
lap  with  the  last  items  of  the  previously  studied 
group 

i 

c.  identifying  all  of  the  checklist  items  and  explaining 
or  performing  their  corresponding  procedural  steps 

d.  encourage  students  to  mentally  practice  running 
through  the  steps  in  the' check!  1st 

(32)  Help  students  to  use  association  devices  that  are  easy  to 
remember,  to  aid  In  the  recall  of  procedures. 

(33)  Positive  reward  should  follow  as  soon  as  possible  after  a 
correct  answer. 

(34)  The  pause  f ol 1 owi ng  knowledge  of  results  should  be  long 
enough  to  allow  the  student  time  to  sort  out  his  errors  or 
mentally  confirm  his  correct  answer,  (post-feedback  delay). 

(35)  Rest  periods  should  be  provided  during  practice  sessions 
according  to  need  for  rest  as  judged  by  the  student  (or) 
requirements  of  the  specific  learning  material  as  judged 
by  the  Instructor. 


I 

I 

i 

i 

! 

! 


F 


F 


F 


v  -6) 

(37) 


(38) 


(39) 


(40) 


Over! earn  the  task  through  extensive  practice. 

In  orcer  for  slower  learners  to  reach  the  same  level  of 
proficiency  as  fa'ster  learners,  time  must  be  allowed  for 
the  slower  learner  to  get  as  many  (or  more)  positive 
rewards  for  correct  answers  as  the  faster  learner. 

As  training  continues,  occasionally  give  the  learner 
chances  to  compare  his  progress  and  achievement  with  the 
stated  course  objectives. 

Train  the  student  to  the  level  of  proficiency  required  on 
the  job.  Facilitate  acquisition  of  the. material  by 
relating  it  to  on-the-job  duties,  responsibilities,  advance 
ment,  or  survival . 

Reduce  forgetting  by  providing  periodic  practice  for 
infrequently  used  procedures. 


o 


o 


o 


o 


o 


o 


o 
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LEARNING  GUIDELINES 


Behavioral  Category  #10  -  Voice  Communicating 


P 

P 

P/F 


P/F 


P/F 


P/F 


P/F 


P/F 


(1)  Break  up  the  presentation  material  into  separate,  distinctive 
types  of  voice  commuriication  that  are  used  on  the  job. 

(2)  Point  out  critical  cues  and  performances  that  are  different 
from  habitual  (everyday  type)  voice  communication. 

(3)  Identify  similar  cues  (sounds,  words,  groups  of  words,  vocal 
patterns,  etc.)  that  are  often  confused  in  job  communications 
and  test  the  student  to  be  sure  that  he  can  tell  the 
difference  between  them. 

(4)  Teach  the  student  to  be  mentally  alert  (perceptual  'set) 
for  the  specific  voice  communications  being  taught;  that 
is,  teach  the  student  to  listen  for  certain  words  and 
phrases . 

(5)  Demonstrate  a  voice  procedure  by  giving  examples  of  correct 
performance.  Be  sure  the  learner  observes  critical  cues 
and  the  appropriate  responses  that  he  should  make  to  them. 

(6)  Toward  the  end  of  training,  increase  stress  and  miscellaneous 
interruptions,  distractions,  and  "noise"  to  the  level  that 
will  appear  on  the  job. 

(7)  Toward  the  end  of  training,  practice  voice  communication 
procedures  to  the  level  that  they  w^ll  have  to  be  performed 
in  the  job  setting. 

(8)  At  the  beginning  of  the  training,  the  instructor  or  the 
materials  should  clearly  inform  the  trainee  of  the 
learning  objectives. 


Organize  the  training  material  in  such  a  way  that  the 
trainee  can  easily  identify  and  meet  the  learning 
objectives. 

Relate  the  learning  objectives  and  activities  to  operational 
tasks  which  the  trainee  must  perform  in  future  real  world 
assignments. 

Present  a  brief  overview  of  the  activities  in  which  the 
students  will  participate  during  training. 

Before  demonstrating  specific  procedures  and  techniques, 
teach  general  voice  communication  terminology  and  procedure. 
Require  enough  practice  trials  of  the  learner  to  produce 
the  correct  performance;  he  should  especially  practice  parts 
he  is  having  difficulty  with  until  he  can  demonstrate  the 
correct  procedure. 

During  practice,  practical  applications,  and  practice  tests, 
provide  the  student  with  immediate  knowledge  of  results 
about  his  correct  and  incorrect  answers. 

Positive  reward  should  follow  as  soon  as  possible  after  a 
correct  answer. 

Rest  periods  should  be  provided  during  practice  sessions 
according  to  need  for  rest  as  judged  by  the  student  and 
requirements  of  the  specific  learning  material  as  judged 
by  the  Instructor. 

.Cross-train  the  learner  so  that  he  may  perform  other  voice 
communication  tasks  and  be  able  to  act  as  a  replacement  for 
other  members  of  his  team. 


•r  (18)  Require  the  student  to  overlearn  the  original  material; 

that  is,  the  student  should  continue  to  practice  the 
required  tasks  after  the  point  that  simple  mastery  of 
the  task  has  been  met. 

F  (19)  Reduce  forgetting  by  providing  periodic  practice  for 
infrequently  used  material. 

F  (20)  Provide  a  large  reward  when  trainee  meets  overall  training 
objectives  and  required  overlearning. 
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